Projection method and projector

Abstract

Projection method and projector. Improve the detection accuracy of points included in a projected point pattern. A projector (1) projects a point pattern (210a) including a first point (231), a second point (232), a third point (233), a fourth point (234), and a black point (235) to a projection surface (7). The display modes of the first point (231), the second point (232), the third point (233), the fourth point (234), and the black point (235) are different from each other, the first point (231) is located adjacent to the second point (232) in a horizontal direction and adjacent to the third point (233) in a vertical direction, the second point (232) is located adjacent to the fourth point (234) in the vertical direction, and the third point (233) is located adjacent to the first point (231) in the horizontal direction.

Description

Technical Field

[0001] This invention relates to projection methods and projectors. Background Technology

[0002] Previously, techniques for correcting positional offsets of images displayed on a display surface were known.

[0003] For example, Patent Document 1 discloses an image projection system that uses an imaging device to capture an image of a two-dimensionally arranged pattern of dots projected onto a projection surface, and corrects the image data that forms the basis of the image projected by the projector based on the captured pattern.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2014-178393

[0005] However, it is desirable to improve the detection accuracy of points contained in the projected dot pattern and to correct the distortion of the projected image with high precision. Summary of the Invention

[0006] One aspect of the projection method of the present invention includes: projecting a first image containing a dot pattern through a projector; acquiring a captured image obtained by capturing the first image; and corresponding the dots of the dot pattern contained in the captured image with the dots of the dot pattern contained in the first image, wherein the dot pattern includes a first dot, a second dot, a third dot, a fourth dot, and a fifth dot, wherein the first dot is displayed in a first display mode, the second dot is displayed in a second display mode different from the first display mode, and the third dot is displayed in a third display mode different from both the first and second display modes. The display mode of point 4 is a fourth display mode that is different from the first display mode, the second display mode, and the third display mode. The display mode of point 5 is a fifth display mode that is different from the first display mode, the second display mode, the third display mode, and the fourth display mode. Point 1 is located adjacent to point 2 in the first direction and adjacent to point 3 in the second direction orthogonal to the first direction. Point 2 is located adjacent to point 4 in the second direction and point 3 is located adjacent to point 1 in the first direction.

[0007] One embodiment of the projector of the present invention includes: a projection unit, an imaging unit, and a control unit. The projection unit projects a first image containing a dot pattern, the imaging unit captures the first image projected by the projection unit, and the control unit matches dots of the dot pattern contained in the captured image with dots of the dot pattern contained in the first image. The dot pattern includes a first dot, a second dot, a third dot, a fourth dot, and a fifth dot. The first dot is displayed in a first display mode, the second dot is displayed in a second display mode different from the first display mode, and the third dot is displayed in a mode different from both the first and second display modes. The third display mode is the same as the fourth display mode, and the display mode of the fourth point is a fourth display mode that is different from the first display mode, the second display mode, and the third display mode. The display mode of the fifth point is a fifth display mode that is different from the first display mode, the second display mode, the third display mode, and the fourth display mode. The first point is located adjacent to the second point in the first direction, and adjacent to the third point in the second direction orthogonal to the first direction. The second point is located adjacent to the fourth point in the second direction, and the third point is located adjacent to the first point in the first direction. Attached Figure Description

[0008] Figure 1 This is a block diagram showing the structure of the projector.

[0009] Figure 2 This is an example of a patterned image.

[0010] Figure 3 It is a diagram showing a simplified pattern image with a reduced number of dots.

[0011] Figure 4 It is a diagram showing a simplified pattern image with a reduced number of dots.

[0012] Figure 5 It is a diagram showing the number of points from the left and right edges of the pattern image to the first point.

[0013] Figure 6 It is a diagram showing the number of points from the left and right edges of the pattern image to the first point.

[0014] Figure 7 It is a diagram showing the number of black dots in the same row as point 1 and the number of dots between the left and right sides of the pattern image.

[0015] Figure 8 It is a diagram showing the number of black dots in the same row as point 1 and the number of dots between the left and right sides of the pattern image.

[0016] Figure 9It is a diagram showing the number of points from the top and bottom edges of the pattern image to point 1.

[0017] Figure 10 It is a diagram showing the number of points from the top and bottom edges of the pattern image to point 1.

[0018] Figure 11 It is a graph showing the number of points between the black dots in the same column as point 1 and the top and bottom edges of the pattern image.

[0019] Figure 12 It is a graph showing the number of points between the black dots in the same column as point 1 and the top and bottom edges of the pattern image.

[0020] Figure 13 This is a diagram showing a variation of a pattern image.

[0021] Figure 14 This is a diagram showing a variation of a pattern image.

[0022] Figure 15 This is a flowchart illustrating the operation of the projector.

[0023] Label Explanation

[0024] 1 Projector; 3 Image supply device; 5 Remote controller; 7 Projection surface; 10 Remote controller light receiving unit; 20 Communication I / F; 30 Imaging unit; 41 Image processing unit; 43 Frame memory; 50 Projection unit; 51 Light source; 53 Light modulation device; 55 Optical unit; 60 Control unit; 70 Storage unit; 71 Control program; 73 Pattern image data; 80 Processor; 200a, 200b Pattern image; 201 Left side; 203 Right side; 205 Top side; 207 Bottom side; 210a, 210b Dot pattern; 230, 250 Detection point; 231 First point; 232 Second point; 233 Third point; 234 Fourth point; 235 Black dot; 251 A point; 252 B point; 253 C point; 254 D point; 255 E point; 256 F point; 257 G point; 258 H point; 259 I point. Detailed Implementation

[0025] 1. Structure of a projector

[0026] Figure 1 This is a block diagram showing the structure of projector 1.

[0027] Projector 1 is a device that generates image light based on image data supplied from image supply device 3 or image data stored in storage unit 70 of projector 1, and displays the generated image light on projection surface 7. Projection surface 7 may be, for example, a screen, an indoor wall, or a whiteboard. Hereinafter, the image data supplied from image supply device 3 and the image data stored in storage unit 70 of projector 1 will be referred to as display image data.

[0028] The projector 1 includes a remote control light receiver 10, a communication interface 20, a camera 30, an image processing unit 41, a frame memory 43, a projection unit 50, and a control unit 60. Hereinafter, the interface will be abbreviated as I / F.

[0029] The light-receiving unit 10 of the remote control receives infrared signals sent from the remote control 5. The light-receiving unit 10 decodes the received infrared signals and generates an operation signal corresponding to the received infrared signals. This generated operation signal corresponds to a button on the remote control 5 operated by the user. The light-receiving unit 10 outputs the generated operation signal to the control unit 60.

[0030] The communication I / F 20 is a communication device equipped with I / F circuitry and is wiredly connected to the image supply device 3. In this embodiment, the projector 1 and the image supply device 3 are described as being connected via a wired connection, but the projector 1 and the image supply device 3 can also be connected wirelessly. The communication I / F 20 outputs the display image data received from the image supply device 3 to the image processing unit 41.

[0031] The imaging unit 30 is a camera equipped with an imaging lens, a CCD (Charge Coupled Device) or CMOS (Complementary MOS) imaging element, and data processing circuitry. Illustrations of the imaging optical system, imaging element, and data processing circuitry are omitted. The imaging unit 30 captures images of at least the area including the projection surface 7 to generate an image. The imaging unit 30 outputs the generated image to the control unit 60.

[0032] The frame memory 43 is connected to the image processing unit 41. The image processing unit 41 writes display image data input from the communication I / F 20 into the frame memory 43 frame by frame. The frame memory 43 has multiple memory banks. Each memory bank has a storage capacity capable of writing one frame of display image data. The frame memory 43 is, for example, constructed of SDRAM (Synchronous Dynamic Random Access Memory).

[0033] The image processing unit 41 performs image processing on the display image data expanded in the frame memory 43, such as resolution conversion or size adjustment, distortion and aberration correction, shape correction, digital zoom, and adjustment of image tone or brightness. The image processing unit 41 executes the image processing specified by the control unit 60, using parameters input from the control unit 60 as needed. Furthermore, the image processing unit 41 can, of course, perform multiple image processing operations in combination. The image processing unit 41 reads the processed display image data from the frame memory 43 and outputs it to the light modulation device 53.

[0034] The image processing unit 41 and the frame memory 43 are, for example, constructed from integrated circuits. Integrated circuits include LSIs, ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), and SoCs (System-on-a-chip). Furthermore, a portion of the integrated circuit structure may include analog circuitry, or it may be a structure combining the control unit 60 and the integrated circuit.

[0035] The projection unit 50 includes a light source 51, a light modulation device 53, and an optical unit 55.

[0036] The light source 51 is composed of solid-state light sources such as halogen lamps, xenon lamps, ultra-high pressure mercury lamps, or LED or laser light sources.

[0037] The light modulation device 53 includes a light modulation element. Based on displayed image data, the light modulation device 53 modulates the light emitted from the light source 51 to generate image light. The light modulation element can be a transmissive liquid crystal panel or a reflective liquid crystal panel. Alternatively, it can be composed of a digital mirror device.

[0038] The optical unit 55 includes optical elements such as a projection lens, which magnifies and projects the image light generated by the light modulation device 53 toward the projection surface 7. As a result, an image based on the image light is displayed on the projection surface 7.

[0039] The control unit 60 is a computer device that includes a storage unit 70 and a processor 80.

[0040] The storage unit 70 includes volatile memory such as RAM (Random Access Memory) and non-volatile memory such as ROM (Read Only Memory). RAM is used for temporary storage of various data, etc., and ROM stores control program 71 for controlling the operation of projector 1, pattern image data 73 (described later), and various setting information.

[0041] The processor 80 is an arithmetic processing device composed of a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The processor 80 executes the control program 71 to control the various parts of the projector 1.

[0042] The control unit 60 instructs the image processing unit 41 to process the display image data received from the communication I / F 20. At this time, the control unit 60 instructs the image processing unit 41 to perform image processing, or outputs parameters used by the image processing unit 41 during processing to the image processing unit 41. Additionally, the control unit 60 activates the drive unit of the drive light source 51 or the light modulation device 53 to drive the light source 51 or the light modulation device 53, generating image light based on the display image data processed by the image processing unit 41. (The illustration of the drive unit is omitted.)

[0043] Furthermore, when the control unit 60 receives an operation to correct the position offset of the image via the remote controller 5, it causes the image processing unit 41 to process the pattern image data 73 and display an image based on the image-processed pattern image data 73 on the projection surface 7. Hereinafter, the image based on the pattern image data 73 will be referred to as pattern image 200a. Pattern image 200a corresponds to the first image.

[0044] The control unit 60 causes the imaging unit 30 to capture an image on the projection surface 7 displaying the patterned image 200a. The control unit 60 performs image analysis on the captured image, detects the detection points 230 (described later), and generates correction data for the positional offset of the correction image based on the detected detection points 230.

[0045] 2. Regarding the structure of patterned images

[0046] Figure 2 This is a diagram showing an example of pattern image 200a.

[0047] Reference Figure 2 The pattern image 200a is described.

[0048] The pattern image 200a has a dot pattern 210a in which multiple points are arranged in a matrix. Figure 2 The pattern image 200a shown has a dot pattern 210a with N rows and M columns. N and M are integers greater than or equal to 3.

[0049] At approximately the center of dot pattern 210a, four dots are arranged in a 2x2 grid with a display method different from the other dots. These four dots are used for position detection, and the positions of the other dots are determined based on the positions of the four detected dots.

[0050] In the 2D coordinate system representing the positions on the pattern image 200a, when the origin is located at the upper left, the point located at the upper left of the four points is called point 1 231, and the point located to the right of point 1 231 and adjacent to point 1 231 is called point 232. Furthermore, the point located below point 1 231 and adjacent to point 1 231 is called point 3 233. And furthermore, the point located below point 232 and adjacent to point 232 is called point 4 234. Hereinafter, point 1 231, point 232, point 3 233, and point 4 234 are collectively referred to as detection point 230.

[0051] Additionally, points other than detection point 230 in the dot pattern 210a formed in the pattern image 200a are referred to as black dots 235. Black dots 235 correspond to the 5th point and are formed by black.

[0052] In this embodiment, point 1 231 is formed in red, point 232 is formed in blue, point 3 233 is formed in green, and point 4 234 is formed in white on a black background. Points 1 231, 232, 333, and 4 234 are colors other than black for point 235, as long as they are formed in different colors.

[0053] In addition, in this embodiment, dots with different display methods are formed by changing the colors of the first dot 231, the second dot 232, the third dot 233, the fourth dot 234 and the black dot 235. However, the first dot 231, the second dot 232, the third dot 233, the fourth dot 234 and the black dot 235 can also be formed in different shapes.

[0054] Here, the reason for placing the detection point 230 approximately in the center of the dot pattern 210a will be explained.

[0055] For example, if the detection point 230 is positioned at the end of the pattern image 200a, and the projector 1 is not properly positioned or aligned with the projection surface 7, sometimes all the detection points 230 cannot be displayed on the projection surface 7.

[0056] To address this, by arranging the detection point 230 approximately in the center of the pattern image 200a as in this embodiment, the frequency of problems such as the inability to detect the first point 231, the second point 232, the third point 233, and the fourth point 234 can be reduced. Furthermore, the positions of the first point 231, the second point 232, the third point 233, and the fourth point 234 can be narrowed down based on the centroid position of all points detected from the captured image.

[0057] Furthermore, regarding the unevenness of the projection surface 7 of the projector 1 projecting the pattern image 200a, the closer the distance, the smaller the change in the degree of unevenness. Therefore, by arranging the first point 231, the second point 232, the third point 233, and the fourth point 234 adjacently in a 2-row, 2-column configuration, the detection accuracy of the first point 231, the second point 232, the third point 233, and the fourth point 234 can be improved.

[0058] Furthermore, by using different colors for the first point 231, the second point 232, the third point 233, and the fourth point 234, which are also different from each other and different from the black point 235, the detection accuracy of the detection point 230 can be improved.

[0059] Figure 3 and Figure 4 This is a diagram showing a simplified pattern image 200a with a reduced number of dots. Specifically, Figure 3 This illustrates the case where N and M are even numbers in a dot pattern 210a with N rows and M columns. Figure 4 This shows the case where N and M in dot pattern 210a are odd numbers.

[0060] Reference Figure 3 as well as Figure 4 The positions of points 1 to 4, 231, in pattern image 200a will be explained. Furthermore, by defining the position of point 1, 231, the positions of points 2, 232 to 4, 234 are naturally also defined; therefore, here, only the position of point 1, 231 will be explained.

[0061] Figure 3 This shows the case where [N] is an even number (6) and [M] is an even number (8) in N rows and M columns.

[0062] Figure 4 This shows the case where [N] is an odd number (7) and [M] is an odd number (9) in N rows and M columns.

[0063] When N is even, the vertical position of point 1231 is the N / 2th point counting from the point at the upper end of the vertical axis. For example, in Figure 3 In the example shown, N is 6, so point 1, 231, is located in the 3rd row. The vertical direction corresponds to the 2nd direction.

[0064] When N is odd, the vertical position of point 1231 is the (N+1) / 2th point counting from the point at the top of the vertical axis. For example, in Figure 4In the example shown, N is 7, so point 231 is located in row 4. In this embodiment, the vertical position of point 231 is set to the N / 2 or (N+1) / 2th position counting from the top end of the vertical axis, but it is not limited to this method. For example, the vertical position of point 231 can also be set to the N / 2 or (N+1) / 2th position counting from the bottom end of the vertical axis.

[0065] When M is even, the lateral position of point 1231 is the M / 2th point counting from the left end of the lateral direction. For example, in Figure 3 In the example shown, M is 8, so point 1, 231, is in column 4. The horizontal direction corresponds to the first direction.

[0066] When M is odd, the horizontal position of point 1231 is the (M+1) / 2th point counting from the left end of the horizontal direction. For example, in Figure 3 In the example shown, M is 9, therefore, point 1, 231, is located in column 5. In this embodiment, the horizontal position of point 1, 231 is set to the M / 2 or (M+1) / 2th position counting from the left end of the horizontal direction, but is not limited to this method. For example, the horizontal position of point 1, 231 can also be set to the M / 2 or (M+1) / 2th position counting from the right end of the horizontal direction.

[0067] Figure 5 This is a diagram showing the number of points from the left 201 and right 203 of pattern image 200a to the first point 231 when the values ​​of N and M are even.

[0068] Figure 6 It is a diagram showing the number of points from the left 201, right 203 to the first point 231 of pattern image 200a when the values ​​of N and M are odd.

[0069] Figure 7 This is a diagram showing the number of dots between the black dot 235, which is in the same row as the first dot 231, and the left 201 and right 203 of the pattern image 200a when the values ​​of N and M are even.

[0070] Figure 8 This is a diagram showing the number of dots between the black dot 235, which is in the same row as the first dot 231, and the left 201 and right 203 of the pattern image 200a when the values ​​of N and M are odd.

[0071] First, refer to Figure 5 as well as Figure 6The number of points arranged between the left side 201, the right side 203 and the first point 231 of the pattern image 200a is explained.

[0072] The number of points between the left side 201 and the first point 231 of the pattern image 200a is called the first number of points, and the number of points between the right side 203 and the first point 231 of the pattern image 200a is called the second number of points.

[0073] like Figure 5 As shown, when the value of M is an even number 8, the number of points 1 is 3 and the number of points 2 is 4.

[0074] In addition, such as Figure 6 As shown, when the value of M is an odd number of 9, the number of points 1 is 4 and the number of points 2 is also 4.

[0075] Therefore, the difference between the first and second points is [0] or [1].

[0076] Next, refer to Figure 7 as well as Figure 8 The number of dots arranged between the left side 201, the right side 203 and the black dot 235 of the pattern image 200a is explained.

[0077] Black dot 235 is black dot 235 configured on the same line as point 1 231.

[0078] Figure 7 The example shows the case where black dot 235 is located in the third row and third column of the leftmost column of point 1 231.

[0079] in addition, Figure 8 This shows the case where black dot 235 is located in the 4th row and 4th column of the leftmost column of point 1 231.

[0080] The number of points between the left side 201 and the black dot 235 of the pattern image 200a is called the third number of points, and the number of points between the right side 203 and the black dot 235 of the pattern image 200a is called the fourth number of points.

[0081] like Figure 7 As shown, when the value of M is an even number 8, the number of points 3 is 2 and the number of points 4 is 5.

[0082] like Figure 8 As shown, when the value of M is an odd number of 9, the number of points 3 is 3 and the number of points 4 is 5.

[0083] Therefore, the difference between the 3rd and 4th points is either "2" or "3". Therefore, the difference between the 1st and 2nd points is less than the difference between the 3rd and 4th points.

[0084] Figure 9 This is a diagram showing the number of points from the top edge 205, bottom edge 207 to the first point 231 of pattern image 200a when the values ​​of N and M are even.

[0085] Figure 10 It is a diagram showing the number of points from the top edge 205, the bottom edge 207 to the first point 231 of pattern image 200a when the values ​​of N and M are odd.

[0086] Figure 11 This is a diagram showing the number of points between the black dot 235 in the same column as point 231 and the top edge 205 and bottom edge 207 of pattern image 200a when the values ​​of N and M are even.

[0087] Figure 12 This is a diagram showing the number of points between the black dot 235, which is in the same column as the first point 231, and the top edge 205 and bottom edge 207 of the pattern image 200a when the values ​​of N and M are odd.

[0088] First, refer to Figure 9 and Figure 10 The number of points arranged between the top edge 205, the bottom edge 207 and the first point 231 of the pattern image 200a is explained.

[0089] The number of points between the top edge 205 of pattern image 200a and the first point 231 is called the 5th point number, and the number of points between the bottom edge 207 of pattern image 200a and the first point 231 is called the 6th point number.

[0090] like Figure 9 As shown, when the value of N is an even number 6, the number of points 5 is 2 and the number of points 6 is 3.

[0091] In addition, such as Figure 10 As shown, when the value of N is an odd number of 7, the 5th point has 3 points and the 6th point also has 3 points.

[0092] Therefore, the difference between the 5th and 6th points is either "0" or "1".

[0093] Next, refer to Figure 11 as well as Figure 12 The number of dots arranged between the top edge 205, the bottom edge 207 and the black dot 235 of the pattern image 200a is explained.

[0094] Black dot 235 is black dot 235 that is configured in the same column as point 1 231.

[0095] Figure 11 This shows the case where black dot 235 is the black dot 235 in the second row and fourth column of the row above point 231.

[0096] in addition, Figure 12 This shows the case where black dot 235 is the black dot 235 in the 3rd row and 5th column of the row above point 231.

[0097] The number of dots between the top edge 205 and the black dot 235 of the pattern image 200a is called the 7th dot, and the number of dots between the bottom edge 207 and the black dot 235 of the pattern image 200a is called the 8th dot.

[0098] like Figure 11 As shown, when the value of M is an even number 6, the 7th point has 1 point and the 8th point has 4 points.

[0099] In addition, such as Figure 12 As shown, when the value of M is an odd number 7, the 7th point has 2 points and the 8th point has 4 points.

[0100] Therefore, the difference between the 7th and 8th points is [2] or [3]. Therefore, the difference between the 5th and 6th points is less than the difference between the 7th and 8th points.

[0101] 3. Examples of pattern image deformation

[0102] Figure 13 as well as Figure 14 This is a diagram showing pattern image 200b, which is a variation of pattern image 200a.

[0103] The modified pattern image 200b has a dot pattern 210b. In dot pattern 210b, the number of detection points 250 is greater than the number of detection points 230 in dot pattern 210a. Detection points 250 include nine points: A251, B252, C253, D254, E255, F256, G257, H258, and I259. Detection points 250 are arranged in a matrix structure with the nine points arranged in three rows and three columns. Point A251 corresponds to point 231 in dot pattern 210a.

[0104] Figure 13 and Figure 14 An example is shown where the letters “A”, “B”, “C”, “D”, “E”, “F”, “G”, “H”, and “I” are displayed at the center of each point in order to identify the points included in detection point 250. The characters used for identification are not limited to letters; they can also be numbers or any characters from other languages.

[0105] In addition, by increasing the number of detection points 250 from 4 to 9, the positions of each point in the dot pattern 210b can be determined using the other detection points 250 when a portion of the detection points 250 cannot be detected.

[0106] Furthermore, in this modified example, the case where the detection point 250 has 9 points arranged in 3 rows and 3 columns is described. However, the number of detection points 250 only needs to be 4 or more.

[0107] In a 2D coordinate system representing the positions on pattern image 200b, with the origin located at the upper left, points A 251, B 252, and C 253 are arranged in the same row of point pattern 210b.

[0108] Points D254, E255, and F256 are arranged in the same row as point pattern 210b, one row down from points A251, B252, and C253.

[0109] Points G257, H258, and I259 are arranged in the same row as point pattern 210b, two rows down from points A251, B252, and C253.

[0110] In addition, points A251, D254 and G257 are arranged in the same column of point pattern 210b.

[0111] Points B252, E255, and H258 are positioned in the same column as point pattern 210b, one column to the right of points A251, D254, and G257.

[0112] Points C253, F256, and I259 are positioned in the same column as point pattern 210b, two columns to the right of points A251, D254, and G257.

[0113] Figure 13 This illustrates the case where N and M are odd numbers in a dot pattern 210b with N rows and M columns.

[0114] When M and N in dot pattern 210b are odd numbers, each point is arranged such that point E255 is located at the center of dot pattern 210b.

[0115] exist Figure 13 In the case of the 7-row, 7-column dot pattern 210b shown, point E 255 is positioned as the fourth point from the left 201, right 203, top 205, and bottom 207.

[0116] Figure 14 This illustrates the case where N and M are even numbers in a dot pattern 210b with N rows and M columns.

[0117] exist Figure 14In the case of the 8-row, 8-column dot pattern 210b shown, points D 254, E 255, and F 256, which are detection points 250, are arranged in the 4th or 5th row starting from the top 205 of the dot pattern 210b. That is, the 2nd row of detection points 250 is arranged in the M / 2th row or the {(M / 2)+1}th row starting from the top of the dot pattern 210b. Figure 14 The example shown is where points D 254, E 255, and F 256 are arranged in the fourth row starting from point pattern 210b.

[0118] In addition, Figure 14 In the case of the 8-row, 8-column dot pattern 210b shown, points B 252, E 255, and H 258, which are the second column of detection points 250, are arranged in the fourth or fifth column from the left side of the dot pattern 210b. That is, the second column of detection points 250 is arranged in the M / 2 or {(M / 2)+1}th column from the left side of the dot pattern 210b. Figure 14 An example is shown where points B 252, E 255, and H 258 are arranged in the fifth column from the left of point pattern 210b.

[0119] 4. Projector operation

[0120] Figure 15 This is a flowchart illustrating the operation of projector 1.

[0121] Reference Figure 15 Explain the operation of projector 1.

[0122] The control unit 60 determines whether the calibration start operation has been accepted (step S1). If the calibration start operation has not been accepted (step S1 / No), the control unit 60 waits until the calibration start operation is accepted.

[0123] Upon receiving a calibration start operation (step S1 / Yes), the control unit 60 first displays the pattern image 200a on the projection surface 7 (step S2). Next, the control unit 60 instructs the imaging unit 30 to perform an image capture (step S3). The imaging unit 30 performs the image capture according to the instructions of the control unit 60 and outputs the captured image to the control unit 60. The control unit 60 then instructs the storage unit 70 to store the input captured image.

[0124] Next, the control unit 60 performs image analysis on the captured image and detects the detection points 230 contained in the captured image (step S4). When the detection point 230 is detected, the control unit 60 calculates the projective transformation matrix (step S5). This matrix is ​​a matrix that transforms the positions of the first point 231, the second point 232, the third point 233, and the fourth point 234 of the pattern image 200a to the positions of the first point 231, the second point 232, the third point 233, and the fourth point 234 of the captured image.

[0125] Next, the control unit 60 uses the calculated projective transformation matrix to perform projective transformation on the positions of each point contained in the pattern image 200a, and determines the points of the captured image based on the positions after projective transformation (step S6).

[0126] Next, the control unit 60 determines whether the correspondence between all points of the pattern image 200a and the points of the captured image is complete (step S7). If there are any points that are not completely matched (step S7 / No), the control unit 60 returns to the processing of step S6.

[0127] Furthermore, when the corresponding condition is met (step S7 / Yes), the control unit 60 generates correction data for the corrected display image based on the position of the points in the corresponding pattern image 200a and the position of the points in the captured image (step S8). Upon completion of the generation of the correction data, the control unit 60 terminates the processing flow.

[0128] 5. Effects of projection methods

[0129] In this embodiment, the control unit 60 of the projector 1 performs the following actions: causing the projection unit 50 to project a pattern image 200a containing a dot pattern 210a; and acquiring a captured image obtained by capturing the pattern image 200a. Additionally, the control unit 60 performs the following action: matching the dots of the dot pattern 210a contained in the captured image with the dots of the dot pattern 210a contained in the pattern image 200a.

[0130] The dot pattern 210a includes the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235.

[0131] The first point 231 is displayed in red, which is the first display mode. The second point 232 is displayed in blue, which is the second display mode, different from the first display mode. The third point 233 is displayed in green, which is the third display mode, different from both the first and second display modes. The fourth point 234 is displayed in white on a black background, which is the fourth display mode, different from the first, second, and third display modes. The black dot 235 is displayed in black, which is the fifth display mode, different from both the first, second, third, and fourth display modes.

[0132] Point 1, 231, is located adjacent to point 232 in the horizontal direction, which is the first direction, and adjacent to point 3, 233 in the vertical direction, which is the second direction orthogonal to the first direction.

[0133] Point 232 is located adjacent to point 4234 in the longitudinal direction, which is the second direction. Point 323 is located adjacent to point 1231 in the transverse direction, which is the first direction.

[0134] According to this structure, the closer the distance to the projection surface 7 of the pattern image 200a projected by the projector 1, the smaller the change in the degree of concavity and convexity. Therefore, the detection accuracy of the first point 231, the second point 232, the third point 233 and the fourth point 234 can be improved.

[0135] In addition, the display methods of points 1 (231), 2 (232), 3 (233), and 4 (234) are different, which can improve the detection accuracy of each point.

[0136] The dot pattern 210a has M dots arranged horizontally. When M is an even number, the horizontal position of the first dot 231 is the M / 2th dot counting from any end of the horizontal direction.

[0137] Additionally, when M is an odd number, the horizontal position of the first point 231 is located at the (M+1) / 2th position counting from either end of the horizontal direction. Furthermore, M is an integer greater than or equal to 3.

[0138] According to this structure, points 1 231, 232, 333, and 4 234 are positioned approximately at the center of the horizontal direction of the pattern image 200a. Therefore, even if there is a problem with the projector 1 not being properly aligned with the projection surface 7, points 1 231, 232, 333, and 4 234 can still be displayed on the projection surface 7. Thus, the frequency of problems such as the inability to detect points 1 231, 232, 333, and 4 234 can be reduced. Furthermore, the positions of points 1 231, 232, 333, and 4 234 can be adjusted based on factors such as the center of gravity of all points detected from the captured image.

[0139] The dot pattern 210a has N dots arranged vertically. When N is even, the first dot 231 is located at the N / 2th dot from any end of the vertical axis.

[0140] When N is odd, the vertical position of the first point 231 is the (N+1) / 2th point counting from either end of the vertical axis. Additionally, N is an integer greater than or equal to 3.

[0141] According to this structure, points 1 231, 232, 333, and 4 234 are positioned approximately at the center of the longitudinal direction of the pattern image 200a. Therefore, even if there is a problem with the projector 1 not being directly aligned with the projection surface 7, points 1 231, 232, 333, and 4 234 can still be displayed on the projection surface 7. Thus, the frequency of problems such as the inability to detect points 1 231, 232, 333, and 4 234 can be reduced. Furthermore, the positions of points 1 231, 232, 333, and 4 234 can be reduced based on factors such as the centroid position of all points detected from the captured image.

[0142] Point 1, 231, is located approximately at the center of pattern image 200a.

[0143] According to this structure, points 1 231, 232, 333, and 4 234 are positioned approximately at the center of the pattern image 200a. Therefore, even if there is a problem with the projector 1 not being directly aligned with the projection surface 7, points 1 231, 232, 333, and 4 234 can still be displayed on the projection surface 7. Thus, the frequency of problems such as the inability to detect points 1 231, 232, 333, and 4 234 can be reduced. Furthermore, the positions of points 1 231, 232, 333, and 4 234 can be reduced based on factors such as the centroid position of all points detected from the captured image.

[0144] The difference between the first and second dots is less than the difference between the third and fourth dots. The first dot is the number of dots located between the left 201 and the first dot 231 of the pattern image 200a. The second dot is the number of dots located between the right 203 (opposite to the left 201) and the first dot 231 of the pattern image 200a in the horizontal direction. The third dot is the number of dots located between the left 201 and the black dot 235 arranged in the same column as the first dot 231. The fourth dot is the number of dots located between the right 203 and the black dot 235.

[0145] According to this structure, in the horizontal direction of the pattern image 200a, the first point 231 is positioned in the center compared to the black point 235. Therefore, even if there is a problem with the setting state where the projector 1 is not directly aligned with the projection surface 7, the first point 231, the second point 232, the third point 233, and the fourth point 234 can be displayed on the projection surface 7. Therefore, the frequency of problems such as the inability to detect the first point 231, the second point 232, the third point 233, and the fourth point 234 can be reduced.

[0146] The difference between the 5th and 6th dots is less than the difference between the 7th and 8th dots. The 5th dot is the number of dots between the top edge 205 and the 1st dot 231 of the pattern image 200a. The 6th dot is the number of dots between the bottom edge 207 and the 1st dot 231. The 7th dot is the number of dots between the top edge 205 and the black dot 235 arranged in the same row as the 1st dot 231. The 8th dot is the number of dots between the bottom edge 207 and the black dot 235.

[0147] According to this structure, in the vertical direction of the pattern image 200a, the first point 231 is positioned in the center compared to the black point 235. Therefore, even if there is a problem with the setting state where the projector 1 is not directly aligned with the projection surface 7, the first point 231, the second point 232, the third point 233, and the fourth point 234 can be displayed on the projection surface 7. Therefore, the frequency of problems such as the inability to detect the first point 231, the second point 232, the third point 233, and the fourth point 234 can be reduced.

[0148] In the dot pattern 210a, in addition to the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235, there is one or more other dots. The display method of one or more dots is the fifth display method.

[0149] According to this structure, in addition to point 1 231, point 232, point 3 233, point 4 234 and black dot 235, it also includes one or more points. The display mode of these one or more points is the fifth display mode. Therefore, the detection accuracy of point 1 231, point 232, point 3 233 and point 4 234 can be improved.

[0150] 6. The effect of the projector's structure

[0151] The projector 1 includes: a projection unit 50 that projects a pattern image 200a containing a dot pattern 210a; an imaging unit 30 that captures the pattern image 200a projected by the projection unit 50; and a control unit 60 that matches the dots of the dot pattern 210a contained in the captured image with the dots of the dot pattern 210a contained in the pattern image 200a.

[0152] The dot pattern 210a includes the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235.

[0153] The display mode of point 1, 231, is formed by red, which is the first display mode. The display mode of point 2, 232, is formed by blue, which is the second display mode, different from the first display mode. The display mode of point 3, 233, is formed by green, which is the third display mode, different from the first and second display modes. The display mode of point 4, 234, is formed by white on a black background, which is the fourth display mode, different from the first, second, and third display modes. The display mode of black dot 235, is formed by black, which is the fifth display mode, different from the first, second, third, and fourth display modes.

[0154] Point 1, 231, is located adjacent to point 232 in the horizontal direction, which is the first direction, and adjacent to point 3, 233 in the vertical direction, which is the second direction orthogonal to the first direction.

[0155] Point 232 is located adjacent to point 4234 in the longitudinal direction, which is the second direction. Point 323 is located adjacent to point 1231 in the transverse direction, which is the first direction.

[0156] According to this structure, the closer the distance to the projection surface 7 of the pattern image 200a projected by the projector 1, the smaller the change in the degree of concavity and convexity. Therefore, the detection accuracy of the first point 231, the second point 232, the third point 233 and the fourth point 234 can be improved.

[0157] In addition, the display methods of points 1 (231), 2 (232), 3 (233), and 4 (234) are different, which can improve the detection accuracy of each point.

[0158] The above-described embodiments and variations are preferred embodiments of the present invention. However, they are not limited thereto, and various variations can be implemented without departing from the spirit of the present invention.

[0159] For example, Figure 15 The processing units in the flowchart shown are divided according to the main processing content for easy understanding of the processing of projector 1. This invention is not subject to... Figure 15 The flowchart illustrates the method of dividing the processing units and the naming restrictions. Furthermore, the processing of projector 1 can be divided into more processing units based on the processing content, or it can be divided into a single processing unit containing more processing steps. Additionally, the processing order in the flowchart is not limited to the example shown.

[0160] in addition, Figure 1The projector 1 shown represents a functional structure achieved through the collaboration of hardware and software, and there are no particular restrictions on the specific installation method. Therefore, it is not necessarily necessary to install hardware corresponding to each functional part, and it is also possible to configure it so that the functions of multiple functional parts are implemented by a single processor executing a program. In addition, in the above embodiment, a part of the function implemented by software can be implemented by hardware, or a part of the function implemented by hardware can be implemented by software.

[0161] Furthermore, when implementing the projection method of the present invention using a computer mounted on projector 1, the program that causes the computer to execute can also be configured as a recording medium. Additionally, the program that causes the computer to execute can also be configured as a transmission medium for transmitting the program. The recording medium can be a magnetic, optical, or semiconductor memory device. Specifically, examples include removable or fixed recording media such as floppy disks, HDDs, CD-ROMs (compact discread-only memory), DVDs (Digital Versatile Discs), Blu-ray Discs, optical disks, flash memory, and card-type recording media. Furthermore, the aforementioned recording media can also be non-volatile storage devices such as RAM, ROM, and HDDs, which are internal storage devices of server devices. Blu-ray is a registered trademark.

[0162] Furthermore, in the above embodiment, the projector 1 is shown to have a capturing unit 30 for capturing pattern image 200a, but it is not limited to this configuration. The projector 1 may also omit the capturing unit 30 and instead generate a captured image of pattern image 200a using a camera separate from the projector 1. In this case, the captured image generated by the camera can be sent to the control unit 60 via the communication I / F 20 provided with the projector 1.

Claims

1. A projection method, comprising: The first image containing the dot pattern is projected using a projector; Obtain the captured image obtained by capturing the first image; as well as Match the dots of the dot pattern contained in the captured image with the dots of the dot pattern contained in the first image. The dot pattern includes point 1, point 2, point 3, point 4, and point 5. The display method of point 1 is the first display method. The second point is displayed in a different way than the first point. The third point is displayed in a way that is different from the first and second display methods. The fourth point is a display method that differs from the first, second, and third display methods. The fifth point is a display method that differs from the first, second, third, and fourth display methods. The first point is located adjacent to the second point in the first direction, and adjacent to the third point in the second direction, which is orthogonal to the first direction. The second point is located adjacent to the fourth point in the second direction. The third point is located adjacent to the fourth point in the first direction. The fifth point, which is displayed in the same way as the first, second, third, and fourth points of the dot pattern, is also displayed. The first point is located approximately at the center of the first image.

2. The projection method according to claim 1, wherein, The dot pattern has M dots arranged in the first direction. When the M points are even, the position of the first point in the first direction is located at the M / 2th point counting from any end of the first direction. When the M points are odd, the position of the first point in the first direction is located at the (M+1) / 2th point counting from any end of the first direction. Where M is an integer number of 3 or more.

3. The projection method according to claim 1 or 2, wherein, The dot pattern has N dots arranged in the second direction. When N is an even number, the position of the first point in the second direction is located at the N / 2th point counting from any end of the second direction. When the number of N points is odd, the position of the first point in the second direction is located at the (N+1) / 2th point counting from any end of the second direction. Wherein, N is an integer number of 3 or more.

4. The projection method according to claim 1 or 2, wherein, The difference between the first and second points is less than the difference between the third and fourth points. The first point number is the number of points located between the first edge of the first image and the first point. The second point is the number of points located between the second side of the first image, which is opposite to the first side in the first direction, and the first point. The third point is the number of points located between the first edge and the fifth point, which is positioned in the same row as the first point. The fourth point is the number of points located between the second edge and the fifth point.

5. The projection method according to claim 1 or 2, wherein, The difference between the 5th and 6th points is less than the difference between the 7th and 8th points. The fifth point is the number of points located between the third edge of the first image and the first point. The sixth point is the number of points located between the fourth side of the first image, which is opposite to the third side in the second direction, and the first point. The seventh point is the number of points located between the third side and the fifth point, which is positioned in the same column as the first point. The 8th point is the number of points located between the 4th edge and the 5th point.

6. A projector comprising: A projection lens that projects a first image containing a dot pattern; A camera that captures the first image projected by the projection lens; as well as The processor matches the dots of the dot pattern contained in the captured image by the camera with the dots of the dot pattern contained in the first image. The dot pattern includes point 1, point 2, point 3, point 4, and point 5. The display method of point 1 is the first display method. The second point is displayed in a different way than the first point. The third point is displayed in a way that is different from the first and second display methods. The fourth point is a display method that differs from the first, second, and third display methods. The fifth point is a display method that differs from the first, second, third, and fourth display methods. The first point is located adjacent to the second point in the first direction, and adjacent to the third point in the second direction, which is orthogonal to the first direction. The second point is located adjacent to the fourth point in the second direction. The third point is located adjacent to the fourth point in the first direction. The fifth point, which is displayed in the same way as the first, second, third, and fourth points of the dot pattern, is also displayed. The first point is located approximately at the center of the first image.

Images