Projection method and projector

Abstract

To improve the accuracy of detecting dots included in a dot pattern to be projected.SOLUTION: A projector 1 projects, on a projection surface 7, a dot pattern 210a including a first dot 231, a second dot 232, a third dot 233, a fourth dot 234, and black dots 235. The display modes of the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dots 235 are different from each other. The first dot 231 is located adjacent to the second dot 232 in the lateral direction and is located adjacent to the third dot 233 in the vertical direction. The second dot 232 is located adjacent to the fourth dot 234 in the vertical direction. The third dot 233 is located adjacent to the first dot 231 in the lateral direction.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a projection method and a projector. [Background technology]

[0002] 2. Description of the Related Art Conventionally, techniques for correcting positional deviation of an image displayed on a display surface have been known. For example, Patent Document 1 discloses an image projection system that uses a photographing device to capture an image of a two-dimensional array of multiple dot patterns projected onto a projection surface, and corrects the image data that forms the basis of the image projected by the projector based on the captured pattern. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-178393 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there is a demand for improving the detection accuracy of dots included in the projected dot pattern and for accurately correcting distortion in the projected image. [Means for solving the problem]

[0005] One aspect of the projection method of the present disclosure includes projecting a first image including a dot pattern by a projector, acquiring a captured image of the first image, and associating dots of the dot pattern captured in the captured image with dots of the dot pattern included in the first image, wherein the dot pattern includes first dots, second dots, third dots, fourth dots, and fifth dots, a display mode of the first dots is a first display mode, a display mode of the second dots is a second display mode different from the first display mode, and a display mode of the third dots is , a third display mode different from the first display mode and the second display mode, the display mode of the fourth dot is a fourth display mode different from the first display mode, the second display mode, and the third display mode, the display mode of the fifth dot is a fifth display mode different from the first display mode, the second display mode, the third display mode, and the fourth display mode, the first dot is located next to the second dot in a first direction and next to the third dot in a second direction perpendicular to the first direction, the second dot is located next to the fourth dot in the second direction, and the third dot is located next to the 4 It is a projection method that is located next to the dot.

[0006] One aspect of the projector disclosed herein includes a projection unit that projects a first image including a dot pattern, a capture unit that captures the first image projected by the projection unit, and a control unit that associates dots of the dot pattern captured in the captured image captured by the capture unit with dots of the dot pattern included in the first image, wherein the dot pattern includes first dots, second dots, third dots, fourth dots, and fifth dots, a display mode of the first dots is a first display mode, a display mode of the second dots is a second display mode different from the first display mode, and a display mode of the third dots is a second display mode different from the first display mode. the display mode of the fourth dot is a fourth display mode different from the first display mode, the second display mode, and the third display mode, the display mode of the fifth dot is a fifth display mode different from the first display mode, the second display mode, the third display mode, and the fourth display mode, the first dot is located next to the second dot in a first direction and next to the third dot in a second direction perpendicular to the first direction, the second dot is located next to the fourth dot in the second direction, and the third dot is located next to the 4 It is a projector located next to the dot. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing the configuration of a projector. [Figure 2] FIG. 10 is a diagram showing an example of a pattern image. [Figure 3] FIG. 10 is a diagram showing a pattern image in which the number of dots is simplified. [Figure 4] FIG. 10 is a diagram showing a pattern image in which the number of dots is simplified. [Figure 5] FIG. 10 is a diagram showing the number of dots between the left and right sides of the pattern image and the first dot. [Figure 6] FIG. 10 is a diagram showing the number of dots between the left and right sides of the pattern image and the first dot. [Figure 7] 10 is a diagram showing the number of dots between a black dot located in the same row as the first dot and the left and right sides of a pattern image. [Figure 8] 10 is a diagram showing the number of dots between a black dot located in the same row as the first dot and the left and right sides of a pattern image. [Figure 9] FIG. 10 is a diagram showing the number of dots between the top and bottom sides of the pattern image and the first dot. [Figure 10] FIG. 10 is a diagram showing the number of dots between the top and bottom sides of the pattern image and the first dot. [Figure 11] 10 is a diagram showing the number of dots between a black dot located in the same column as a first dot and the top and bottom sides of a pattern image. [Figure 12] 10 is a diagram showing the number of dots between a black dot located in the same column as a first dot and the top and bottom sides of a pattern image. [Figure 13] FIG. 10 is a diagram showing a modified example of a pattern image. [Figure 14] FIG. 10 is a diagram showing a modified example of a pattern image. [Figure 15] 10 is a flowchart showing the operation of the projector. DETAILED DESCRIPTION OF THE INVENTION

[0008] 1.Projector configuration FIG. 1 is a block diagram showing the configuration of a projector 1. As shown in FIG. The projector 1 is a device that generates image light based on image data supplied from the image supply device 3 or image data stored in a storage unit 70 of the projector 1, and displays the generated image light on a projection surface 7. The projection surface 7 may be, for example, a screen, or an indoor wall or whiteboard. The image data supplied from the image supply device 3 or the image data stored in the storage unit 70 of the projector 1 will be referred to as display image data below.

[0009] The projector 1 includes a remote control receiver 10, a communication interface 20, a photographing unit 30, an image processing unit 41, a frame memory 43, a projection unit 50, and a control unit 60. Hereinafter, the interface will be abbreviated as I / F.

[0010] The remote control light receiving unit 10 receives an infrared signal transmitted from the remote control 5. The remote control light receiving unit 10 decodes the received infrared signal and generates an operation signal corresponding to the received infrared signal. The operation signal generated here is a signal corresponding to the button on the remote control 5 operated by the user. The remote control light receiving unit 10 outputs the generated operation signal to the control unit 60.

[0011] The communication I / F 20 is a communication device equipped with an I / F circuit, and is connected to the image supply device 3 by wire. In this embodiment, a case will be described in which the projector 1 and the image supply device 3 are connected by wire, but the projector 1 and the image supply device 3 may also be connected wirelessly. The communication I / F 20 outputs display image data received from the image supply device 3 to the image processing unit 41.

[0012] The photographing unit 30 is a camera equipped with a photographing lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), and a data processing circuit. The photographing optical system, imaging element, and data processing circuit are not shown. The photographing unit 30 photographs an area including at least the projection surface 7 to generate a photographed image. The photographing unit 30 outputs the generated photographed image to the control unit 60.

[0013] A frame memory 43 is connected to the image processing unit 41. The image processing unit 41 writes the display image data input from the communication I / F 20 into the frame memory 43 frame by frame. The frame memory 43 has a plurality of banks. Each bank has a storage capacity sufficient to write one frame of display image data. The frame memory 43 is configured, for example, by an SDRAM (Synchronous Dynamic Random Access Memory).

[0014] The image processing unit 41 performs image processing such as resolution conversion or resizing, distortion correction, shape correction, digital zooming, and adjustment of image color and brightness on the display image data stored in the frame memory 43. The image processing unit 41 executes image processing specified by the control unit 60, and performs processing using parameters input from the control unit 60 as necessary. Of course, the image processing unit 41 can also execute a combination of multiple image processing operations described above. The image processing unit 41 reads the processed display image data from the frame memory 43 and outputs it to the light modulation device 53.

[0015] The image processing unit 41 and the frame memory 43 are configured, for example, by integrated circuits. Examples of integrated circuits include LSIs, ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), and SoCs (System-on-a-chips). An analog circuit may be included as part of the integrated circuit configuration, or the control unit 60 may be configured in combination with an integrated circuit.

[0016] The projection unit 50 includes a light source 51 , a light modulation device 53 , and an optical unit 55 .

[0017] The light source 51 is configured by a lamp such as a halogen lamp, a xenon lamp, or an ultra-high pressure mercury lamp, or a solid-state light source such as an LED or laser light source.

[0018] The light modulation device 53 includes a light modulation element. The light modulation device 53 generates image light by modulating the light emitted by the light source 51 based on the display image data. The light modulation element may be a transmissive liquid crystal panel or a reflective liquid crystal panel. The light modulation element may also be configured by a digital mirror device.

[0019] The optical unit 55 includes optical elements such as a projection lens, and enlarges and projects the image light generated by the light modulation device 53 onto the projection surface 7. As a result, an image based on the image light is displayed on the projection surface 7.

[0020] The control unit 60 is a computer device that includes a memory unit 70 and a processor 80 .

[0021] The storage unit 70 includes a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as a ROM (Read Only Memory). The RAM is used for temporary storage of various data, and the ROM stores a control program 71 used to control the operation of the projector 1, pattern image data 73 (described later), and various setting information.

[0022] The processor 80 is an arithmetic processing device that includes a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The processor 80 executes a control program 71 to control each part of the projector 1.

[0023] The control unit 60 causes the image processing unit 41 to process the display image data received via the communication I / F 20. At this time, the control unit 60 instructs the image processing unit 41 to perform image processing, and outputs parameters used by the image processing unit 41 for processing to the image processing unit 41. The control unit 60 also operates a drive unit that drives the light source 51 and the light modulation device 53 to drive the light source 51 and the light modulation device 53, thereby generating image light based on the display image data processed by the image processing unit 41. The drive unit is not shown in the figure.

[0024] Furthermore, when control unit 60 receives an operation to correct image positional deviation via remote control 5, it causes image processing unit 41 to process pattern image data 73 and displays an image based on the processed pattern image data 73 on projection surface 7. The image based on pattern image data 73 will be referred to as pattern image 200a below. Pattern image 200a corresponds to the first image.

[0025] The control unit 60 acquires a captured image by having the imaging unit 30 capture the projection surface 7 on which the pattern image 200a is displayed. The control unit 60 performs image analysis on the acquired captured image to detect detection dots 230 (described later), and generates correction data for correcting positional deviation of the image based on the detected detection dots 230.

[0026] 2. About the composition of pattern images FIG. 2 is a diagram showing an example of a pattern image 200a. The pattern image 200a will be described with reference to FIG. The pattern image 200a has a dot pattern 210a in which a plurality of dots are arranged in a matrix. The pattern image 200a shown in Fig. 2 has the dot pattern 210a with N rows and M columns, where N and M are integers of 3 or greater.

[0027] Approximately in the center of dot pattern 210a, four dots whose display mode differs from the other dots are arranged in two rows and two columns. These four dots are used for position detection, and the positions of the other dots are identified based on the positions of the detected four dots. In a two-dimensional coordinate system indicating positions on the pattern image 200a, if the origin is located at the upper left, of the four dots, the dot located at the upper left is referred to as the first dot 231, and the dot located next to the first dot 231 on the right side of the first dot 231 is referred to as the second dot 232. Furthermore, the dot located next to the first dot 231 below the first dot 231 is referred to as the third dot 233. Furthermore, the dot located next to the second dot 232 below the second dot 232 is referred to as the fourth dot 234. Hereinafter, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 will be collectively referred to as the detection dot 230.

[0028] Of the dot pattern 210a formed in the pattern image 200a, the dots other than the detection dots 230 are referred to as black dots 235. The black dots 235 correspond to fifth dots and are formed in black color.

[0029] In this embodiment, the first dots 231 are formed in red, the second dots 232 are formed in blue, the third dots 233 are formed in green, and the fourth dots 234 are formed in white on a black background. The first dots 231, the second dots 232, the third dots 233, and the fourth dots 234 may be formed in any color other than the black of the black dots 235, as long as they are formed in different colors. In addition, in this embodiment, dots with different display modes are formed by changing the colors of the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235, but the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235 may also be formed in different shapes.

[0030] Here, the reason why the detection dot 230 is placed substantially in the center of the dot pattern 210a will be explained. For example, if the detection dots 230 are placed at the edge of the pattern image 200a, if the projector 1 is not installed in an appropriate state, such as not facing the projection surface 7 directly, it may not be possible to display all of the detection dots 230 on the projection surface 7. In contrast to this, by arranging the detection dot 230 at approximately the center of the pattern image 200a as in this embodiment, it is possible to reduce the frequency of problems such as not being able to detect the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234. In addition, based on the positions of the centers of gravity of all dots detected from the captured image, No. It is also possible to narrow down the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234.

[0031] Furthermore, the closer the distance is, the smaller the change in the degree of unevenness of the projection surface 7 onto which the projector 1 projects the pattern image 200a. Therefore, by arranging the first dots 231, the second dots 232, the third dots 233, and the fourth dots 234 adjacent to each other in two rows and two columns, it is possible to improve the detection accuracy of the first dots 231, the second dots 232, the third dots 233, and the fourth dots 234. Furthermore, by forming the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 in different colors, which are also different from the black dot 235, the detection accuracy of the detection dot 230 can be improved.

[0032] 3 and 4 are diagrams showing a pattern image 200a in which the number of dots is simplified. In particular, Fig. 3 shows a dot pattern 210a having N rows and M columns, where N and M are even numbers, and Fig. 4 shows a dot pattern 210a in which N and M are odd numbers. The positions of the first dot 231 to the fourth dot 234 in the pattern image 200a will be described with reference to Figures 3 and 4. Note that by defining the position of the first dot 231, the positions of the second dot 232 to the fourth dot 234 are also defined automatically, so only the position of the first dot 231 will be described here.

[0033] FIG. 3 shows a case where "N" in N rows and M columns is an even number, 6, and "M" is an even number, 8. FIG. 4 shows a case where "N" in N rows and M columns is an odd number 7 and "M" is an odd number 9. If N is an even number, the vertical position of the first dot 231 is the N / 2th dot counting from the dot located at the top end in the vertical direction. For example, in the example shown in Figure 3, N is 6, so the first dot 231 is located in the third row. The vertical direction corresponds to the second direction. When N is an odd number, the vertical position of the first dot 231 is the (N+1) / 2th dot from the dot located at the top end in the vertical direction. For example, in the example shown in FIG. 4, N is 7, so the first dot 231 is located on the fourth row. In this embodiment, the vertical position of the first dot 231 is the N / 2th or (N+1) / 2th dot from the dot located at the top end in the vertical direction, but is not limited to this. For example, the vertical position of the first dot 231 may be the N / 2th or (N+1) / 2th dot from the dot located at the bottom end in the vertical direction.

[0034] If M is an even number, the horizontal position of the first dot 231 is M / 2 dots from the dot located at the left end in the horizontal direction. For example, in the example shown in Figure 3, M is 8, so the first dot 231 is located in the fourth column. The horizontal direction corresponds to the first direction. When M is an odd number, the horizontal position of the first dot 231 is (M+1) / 2 dots from the dot located at the left end in the horizontal direction. For example, in the example shown in FIG. 3, M is 9, so the first dot 231 is located in the fifth column. In this embodiment, the horizontal position of the first dot 231 is the M / 2 or (M+1) / 2 dots from the dot located at the left end in the horizontal direction, but this is not limiting. For example, the horizontal position of the first dot 231 may be the M / 2 or (M+1) / 2 dots from the dot located at the right end in the horizontal direction.

[0035] FIG. 5 is a diagram showing the number of dots between the left side 201 and the right side 203 of the pattern image 200a and the first dot 231 when the values ​​of N and M are even numbers. FIG. 6 is a diagram showing the number of dots between the left side 201 and the right side 203 of the pattern image 200a and the first dot 231 when the values ​​of N and M are odd numbers. FIG. 7 is a diagram showing the number of dots between the black dot 235 located on the same row as the first dot 231 and the left side 201 and right side 203 of the pattern image 200a when the values ​​of N and M are even numbers. FIG. 8 is a diagram showing the number of dots between the black dot 235 located on the same row as the first dot 231 and the left side 201 and right side 203 of the pattern image 200a when the values ​​of N and M are odd numbers.

[0036] First, the number of dots arranged between the left side 201 and the right side 203 of the pattern image 200a and the first dot 231 will be described with reference to FIGS. The number of dots between the left side 201 of the pattern image 200a and the first dot 231 is referred to as the first dot number, and the number of dots between the right side 203 of the pattern image 200a and the first dot 231 is referred to as the second dot number. As shown in FIG. 5, when the value of M is an even number of 8, the number of first dots is three and the number of second dots is four. Furthermore, as shown in FIG. 6, when the value of M is an odd number of 9, the number of first dots is four and the number of second dots is also four. Therefore, the difference between the first dot number and the second dot number is either "0" or "1".

[0037] Next, the number of dots arranged between the left side 201 and the right side 203 of the pattern image 200a and the black dot 235 will be described with reference to FIGS. The black dot 235 is a black dot 235 arranged in the same row as the first dot 231 . FIG. 7 shows a case where the black dot 235 is located in the third row and third column, one column to the left of the first dot 231. 8 also shows a case where the black dot 235 is the black dot 235 in the fourth row and fourth column, which is arranged one column to the left of the first dot 231. In FIG. The number of dots between the left side 201 of the pattern image 200a and the black dot 235 is called the third dot number, and the number of dots between the right side 203 of the pattern image 200a and the black dot 235 is called the fourth dot number. As shown in FIG. 7, when the value of M is an even number of 8, the number of third dots is 2 and the number of fourth dots is 5. As shown in FIG. 8, when the value of M is an odd number of 9, the third dot number is three and the fourth dot number is five. Therefore, the difference between the third dot number and the fourth dot number is either 2 or 3. Therefore, the difference between the first dot number and the second dot number is smaller than the difference between the third dot number and the fourth dot number.

[0038] FIG. 9 is a diagram showing the number of dots between the upper side 205 and the lower side 207 of the pattern image 200a and the first dot 231 when the values ​​of N and M are even numbers. FIG. 10 is a diagram showing the number of dots between the upper side 205 and the lower side 207 of the pattern image 200a and the first dot 231 when the values ​​of N and M are odd numbers. FIG. 11 is a diagram showing the number of dots between the black dot 235 located in the same column as the first dot 231 and the upper side 205 and lower side 207 of the pattern image 200a when the values ​​of N and M are even numbers. FIG. 12 is a diagram showing the number of dots between the black dot 235 located in the same column as the first dot 231 and the upper side 205 and lower side 207 of the pattern image 200a when the values ​​of N and M are odd numbers.

[0039] First, the number of dots arranged between the upper side 205 and the lower side 207 of the pattern image 200a and the first dot 231 will be described with reference to FIGS. The number of dots between the upper side 205 of the pattern image 200a and the first dot 231 is called the fifth dot number, and the number of dots between the lower side 207 of the pattern image 200a and the first dot 231 is called the sixth dot number. As shown in FIG. 9, when the value of N is an even number of 6, the number of fifth dots is two and the number of sixth dots is three. Furthermore, as shown in FIG. 10, when the value of N is an odd number of 7, the number of fifth dots is three and the number of sixth dots is also three. Therefore, 5 Number of dots and 6 The difference from the number of dots will be either "0" or "1".

[0040] Next, the number of dots arranged between the upper side 205 and the lower side 207 of the pattern image 200a and the black dot 235 will be described with reference to FIGS. The black dot 235 is a black dot 235 arranged in the same column as the first dot 231 . FIG. 11 shows a case where the black dot 235 is the black dot 235 in the second row and fourth column, which is one row above the first dot 231. 12 also shows a case where the black dot 235 is the black dot 235 in the third row and fifth column, which is the row immediately above the first dot 231. In FIG. The number of dots between the upper side 205 of the pattern image 200a and the black dot 235 is called the seventh dot number, and the number of dots between the lower side 207 of the pattern image 200a and the black dot 235 is called the eighth dot number. As shown in FIG. 11, when the value of M is an even number of 6, the seventh dot number is 1 and the eighth dot number is 4. Furthermore, as shown in FIG. 12, when the value of M is an odd number of 7, the number of seventh dots is two and the number of eighth dots is four. Therefore, the difference between the seventh and eighth dot numbers is either 2 or 3. Therefore, the difference between the fifth and sixth dot numbers is smaller than the difference between the seventh and eighth dot numbers.

[0041] 3. Modification of pattern image 13 and 14 are diagrams showing a pattern image 200b which is a modified example of the pattern image 200a. The pattern image 200b of the modified example includes a dot pattern 210b. The dot pattern 210b includes a greater number of detection dots 250 than the dot pattern 210a includes. The detection dots 250 include nine dots: A dot 251, B dot 252, C dot 253, D dot 254, E dot 255, F dot 256, G dot 257, H dot 258, and I dot 259. The detection dots 250 are configured in a matrix of nine dots, three rows and three columns. The A dot 251 corresponds to the first dot 231 of the dot pattern 210a.

[0042] 13 and 14 show examples in which the letters "A," "B," "C," "D," "E," "F," "G," "H," and "I" are displayed in the center of each dot to identify each dot included in the detection dots 250. The letters used for identification are not limited to alphabets, but may also be numbers or any characters in other languages.

[0043] In addition, by increasing the number of detection dots 250 from four to nine, if some of the detection dots 250 cannot be detected, the positions of each dot in the dot pattern 210b can be identified using the other detection dots 250. In this modified example, the detection dots 250 are described as having nine dots in three rows and three columns, but the number of detection dots 250 may be four or more.

[0044] In a two-dimensional coordinate system indicating positions on the pattern image 200b, when the origin is located at the upper left, the A dots 251, B dots 252, and C dots 253 are arranged on the same row of the dot pattern 210b. D dots 254, E dots 255, and F dots 256 are arranged in the same row of dot pattern 210b, and one row below A dots 251, B dots 252, and C dots 253. G dots 257, H dots 258, and I dots 259 are arranged in the same row of dot pattern 210b, and two rows below A dots 251, B dots 252, and C dots 253.

[0045] Additionally, the A dots 251, D dots 254, and G dots 257 are arranged in the same row of the dot pattern 210b. The B dots 252, E dots 255, and H dots 258 are in the same row of the dot pattern 210b, and are one row behind the A dots 251, D dots 254, and G dots 257. right will be placed in. The C dots 253, F dots 256, and I dots 259 are in the same row of the dot pattern 210b, and are two rows shorter than the A dots 251, D dots 254, and G dots 257. right will be placed in.

[0046] FIG. 13 shows a dot pattern 210b having N rows and M columns, where N and M are odd numbers. When M and N of dot pattern 210b are odd numbers, each dot is arranged so that E dot 255 is located at the center of dot pattern 210b. In the case of the 7-row, 7-column dot pattern 210b shown in FIG. 13, E dots 255 are placed at the fourth dot positions from the left side 201, right side 203, top side 205 and bottom side 207, respectively.

[0047] FIG. 14 shows a dot pattern 210b having N rows and M columns, where N and M are even numbers. In the case of the 8-row, 8-column dot pattern 210b shown in Fig. 14, the D dots 254, E dots 255, and F dots 256 in the second row of the detection dots 250 are arranged in the fourth or fifth row from the top side 205 of the dot pattern 210b. In other words, the second row of the detection dots 250 are arranged in the M / 2th or {(M / 2)+1}th row from the top of the dot pattern 210b. Fig. 14 shows an example in which the D dots 254, E dots 255, and F dots 256 are arranged in the fourth row from the top of the dot pattern 210b.

[0048] 14, the B dots 252, E dots 255, and H dots 258, which make up the second column of detection dots 250, are positioned in the fourth or fifth column from the left of dot pattern 210b. That is, the second column of detection dots 250 is positioned in the (M / 2)-th or ((M / 2)+1)-th column from the left of dot pattern 210b. FIG. 14 shows an example in which B dots 252, E dots 255, and H dots 258 are positioned in the fifth column from the left of dot pattern 210b.

[0049] 4. Projector operation FIG. 15 is a flowchart showing the operation of the projector 1. The operation of the projector 1 will be described with reference to FIG. The control unit 60 determines whether or not a correction start operation has been received (step S1). If a correction start operation has not been received (step S1 / NO), the control unit 60 waits until a correction start operation is received.

[0050] When the control unit 60 receives an operation to start correction (step S1 / YES), it first displays the pattern image 200a on the projection surface 7 (step S2). Next, the control unit 60 causes the photographing unit 30 to photograph and acquire a photographed image (step S3). The photographing unit 30 photographs in accordance with an instruction from the control unit 60, and outputs the photographed image generated by photographing to the control unit 60. The control unit 60 stores the input photographed image in the storage unit 70.

[0051] Next, the control unit 60 performs image analysis on the captured image to detect the detection dots 230 captured in the captured image (step S4). After detecting the detection dots 230, the control unit 60 calculates a determinant of a projective transformation (step S5). This determinant is a determinant that transforms the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 in the pattern image 200a into the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 in the captured image.

[0052] Next, the control unit 60 performs projective transformation on the position of each dot included in the pattern image 200a using the calculated determinant of projective transformation, and identifies the dots in the captured image based on the positions after projective transformation (step S6).

[0053] Next, the control unit 60 determines whether or not all dots in the pattern image 200a have been associated with dots in the captured image (step S7). If there are dots for which association has not been completed (step S7 / NO), the control unit 60 returns to the process of step S6.

[0054] Furthermore, when the association is completed (step S7 / YES), the control unit 60 generates correction data for correcting the display image based on the positions of the dots in the associated pattern image 200a and the positions of the dots in the captured image (step S8). When the generation of the correction data is completed, the control unit 60 ends this processing flow.

[0055] 5. Effects of projection methods The control unit 60 of the projector 1 of this embodiment causes the projection unit 50 to project a pattern image 200a including a dot pattern 210a, and acquires a captured image of the pattern image 200a. The control unit 60 also associates the dots of the dot pattern 210a captured in the captured image with the dots of the dot pattern 210a included in the pattern image 200a.

[0056] The dot pattern 210 a includes a first dot 231 , a second dot 232 , a third dot 233 , a fourth dot 234 , and a black dot 235 . The display mode of the first dot 231 is formed in red, which is a first display mode. The display mode of the second dot 232 is formed in blue, which is a second display mode different from the first display mode. The display mode of the third dot 233 is formed in green, which is a third display mode different from the first and second display modes. The display mode of the fourth dot 234 is formed in white on a black background, which is a fourth display mode different from the first, second, and third display modes. The display mode of the black dot 235 is formed in black, which is a fifth display mode different from the first, second, third, and fourth display modes. The first dot 231 is located next to the second dot 232 in the horizontal direction, which is a first direction, and is located next to the third dot 233 in the vertical direction, which is a second direction perpendicular to the first direction. The second dot 232 is located next to the fourth dot 234 in the vertical direction, which is the second direction. The third dot 233 is located next to the fourth dot 234 in the horizontal direction, which is the first direction. 4 Dot 23 4 Located next to.

[0057] According to this configuration, the unevenness of the projection surface 7 onto which the projector 1 projects the pattern image 200a changes less the closer the distance, thereby improving the detection accuracy of the first dot 231, the second dot 232, the third dot 233 and the fourth dot 234. Furthermore, since the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 are displayed in different modes, the detection accuracy of each dot can be improved.

[0058] The dot pattern 210a has M dots arranged in the horizontal direction. When M is an even number, the first dot 231 is located M / 2 dots in the horizontal direction, counting from the dot at either end in the horizontal direction. Furthermore, when M is an odd number, the horizontal position of the first dot 231 is (M+1) / 2 dots counting from the dot at either end in the horizontal direction, and M is an integer of 3 or greater.

[0059] According to this configuration, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 are arranged in approximately the center of the horizontal direction of the pattern image 200a. Therefore, even if there is a problem with the installation state, such as the projector 1 not facing the projection surface 7 directly, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be displayed on the projection surface 7. This reduces the frequency of problems such as the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 not being detectable. In addition, based on the center of gravity positions of all dots detected from the captured image, No. It is also possible to narrow down the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234.

[0060] The dot pattern 210a has N dots arranged in the vertical direction. When N is an even number, the first dot 231 is located N / 2 dots in the vertical direction, counting from the dot at either end in the vertical direction. When N is an odd number, the vertical position of the first dot 231 is (N+1) / 2 dots counting from the dot at either end in the vertical direction, where N is an integer of 3 or greater.

[0061] According to this configuration, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 are arranged in approximately the center of the vertical direction of the pattern image 200a. Therefore, even if there is a problem with the installation state, such as the projector 1 not facing the projection surface 7 directly, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be displayed on the projection surface 7. This reduces the frequency of problems such as the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 not being able to be detected. In addition, based on the positions of the centers of gravity of all dots detected from the captured image, No. It is also possible to narrow down the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234.

[0062] The first dot 231 is located approximately in the center of the pattern image 200a.

[0063] According to this configuration, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 are arranged approximately in the center of the pattern image 200a. Therefore, even if there is a problem with the installation state, such as the projector 1 not facing the projection surface 7 directly, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be displayed on the projection surface 7. This reduces the frequency of problems such as the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 not being detectable. In addition, based on the center of gravity positions of all dots detected from the captured image, No. It is also possible to narrow down the positions of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234.

[0064] The first dot number is the number of dots between the left side 201 of the pattern image 200a and the first dot 231. Number of and the second dot number, which is the number of dots between the right side 203 of the pattern image 200a, which is opposite to the left side 201 in the horizontal direction, and the first dot 231. Number ofThe difference between the third number of dots, which is the number of dots between the left side 201 and the black dot 235 arranged in the same column as the first dot 231, and the fourth number of dots, which is the number of dots between the right side 203 and the black dot 235, is smaller than the difference between the third number of dots, which is the number of dots between the left side 201 and the black dot 235.

[0065] According to this configuration, the first dot 231 is arranged more centrally than the black dots 235 in the horizontal direction of the pattern image 200a. Therefore, even if there is a problem with the installation state, such as the projector 1 not facing the projection surface 7 directly, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be displayed on the projection surface 7. This makes it possible to reduce the frequency of problems such as the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 not being detectable.

[0066] The difference between the fifth number of dots, which is the number of dots between the top side 205 of the pattern image 200a and the first dot 231, and the sixth number of dots, which is the number of dots between the bottom side 207 and the first dot 231, is smaller than the difference between the seventh number of dots, which is the number of dots between the top side 205 and the black dot 235 arranged in the same row as the first dot 231, and the eighth number of dots, which is the number of dots between the bottom side 207 and the black dot 235.

[0067] According to this configuration, the first dot 231 is arranged more centrally than the black dots 235 in the vertical direction of the pattern image 200a. Therefore, even if there is a problem with the installation state, such as the projector 1 not facing the projection surface 7 directly, the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be displayed on the projection surface 7. This makes it possible to reduce the frequency of problems such as the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 not being detectable.

[0068] The dots included in the dot pattern 210a include one or more dots in addition to the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235. The display mode of the one or more dots is the fifth display mode.

[0069] According to this configuration, one or more dots are included in addition to the first dot 231, the second dot 232, the third dot 233, the fourth dot 234, and the black dot 235, and the display mode of this one or more dots is the fifth display mode, so the detection accuracy of the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 can be improved.

[0070] 6. Effects of projector configuration The projector 1 includes a projection unit 50 that projects a pattern image 200a including a dot pattern 210a, a capturing unit 30 that captures the pattern image 200a projected by the projection unit 50, and a control unit 60 that associates the dots of the dot pattern 210a captured in the captured image captured by the capturing unit with the dots of the dot pattern 210a included in the pattern image 200a.

[0071] The dot pattern 210 a includes a first dot 231 , a second dot 232 , a third dot 233 , a fourth dot 234 , and a black dot 235 . The display mode of the first dot 231 is formed in red, which is a first display mode. The display mode of the second dot 232 is formed in blue, which is a second display mode different from the first display mode. The display mode of the third dot 233 is formed in green, which is a third display mode different from the first and second display modes. The display mode of the fourth dot 234 is formed in white on a black background, which is a fourth display mode different from the first, second, and third display modes. The display mode of the black dot 235 is formed in black, which is a fifth display mode different from the first, second, third, and fourth display modes. The first dot 231 is located next to the second dot 232 in the horizontal direction, which is a first direction, and is located next to the third dot 233 in the vertical direction, which is a second direction perpendicular to the first direction. The second dot 232 is located next to the fourth dot 234 in the vertical direction, which is the second direction. The third dot 233 is located next to the fourth dot 234 in the horizontal direction, which is the first direction. 4 Dot 23 4 Located next to.

[0072] According to this configuration, the unevenness of the projection surface 7 onto which the projector 1 projects the pattern image 200a changes less the closer the distance, thereby improving the detection accuracy of the first dot 231, the second dot 232, the third dot 233 and the fourth dot 234. Furthermore, since the first dot 231, the second dot 232, the third dot 233, and the fourth dot 234 are displayed in different modes, the detection accuracy of each dot can be improved.

[0073] The above-described embodiment and each modification are preferred embodiments of the present invention, but the present invention is not limited to these and various modifications are possible within the scope of the gist of the present invention. For example, the processing units in the flowchart shown in FIG. 15 are divided according to the main processing content in order to make the processing of the projector 1 easier to understand. The present invention is not limited by the way in which the processing units shown in the flowchart of FIG. 15 are divided or the names of the processing units. Furthermore, the processing of the projector 1 can be divided into even more processing units according to the processing content, or one processing unit can be divided so that it includes even more processes. Furthermore, the processing order of the above flowchart is not limited to the example shown in the figure.

[0074] 1 indicates a functional configuration realized by the cooperation of hardware and software, and the specific implementation form is not particularly limited. Therefore, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to configure the projector 1 so that the functions of multiple functional units are realized by a single processor executing a program. Furthermore, some of the functions realized by software in the above embodiments may be realized by hardware, or some of the functions realized by hardware may be realized by software.

[0075] Furthermore, when the projection method of the present disclosure is realized using a computer installed in the projector 1, the program executed by the computer can be configured in the form of a recording medium. The program executed by the computer can also be configured in the form of a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specifically, a flexible disk, HDD, CD-ROM (compact disc read-only memory), DVD (Digital Ve Examples of such recording media include portable and fixed recording media such as portable discs, Blu-ray discs, magneto-optical discs, flash memories, and card-type recording media. Furthermore, the recording media may be non-volatile storage devices such as RAM, ROM, and HDDs that are internal storage devices provided in the server device. Blu-ray is a registered trademark.

[0076] Furthermore, in the above-described embodiment, the projector 1 is illustrated as having the image capturing unit 30 that captures the pattern image 200a, but the present invention is not limited to this. The projector 1 may not be equipped with the image capturing unit 30, and a captured image may be generated by capturing the pattern image 200a using a camera separate from the projector 1. In this case, the captured image generated by the camera may be transmitted to the control unit 60 via the communication I / F 20 included in the projector 1. [Explanation of symbols]

[0077] 1...projector, 3...image supply device, 5...remote control, 7...projection surface, 10...remote control light receiving unit, 20...communication I / F, 30...capturing unit, 41...image processing unit, 43...frame memory, 50...projection unit, 51...light source, 53...light modulation device, 55...optical unit, 60...control unit, 70...storage unit, 71...control program, 73...pattern image data, 80...processor, 200a, 200b...pattern image, 201...left side , 203...right side, 205...upper side, 207...lower side, 210a, 210b...dot pattern, 230, 250...detection dot, 231...first dot, 232...second dot, 233...third dot, 234...fourth dot, 235...black dot, 251...A dot, 252...B dot, 253...C dot, 254...D dot, 255...E dot, 256...F dot, 257...G dot, 258...H dot, 259...I dot.

Claims

1. projecting a first image including a dot pattern by a projector; acquiring a captured image obtained by capturing the first image; and associating the dots of the dot pattern captured in the captured image with the dots of the dot pattern included in the first image, the dot pattern includes a first dot, a second dot, a third dot, a fourth dot, and a fifth dot, the display mode of the first dot is a first display mode, the display mode of the second dot is a second display mode different from the first display mode, a display mode of the third dot is a third display mode different from the first display mode and the second display mode, a display mode of the fourth dot is a fourth display mode different from the first display mode, the second display mode, and the third display mode, a display mode of the fifth dot is a fifth display mode different from the first display mode, the second display mode, the third display mode, and the fourth display mode, the first dot is located adjacent to the second dot in a first direction and adjacent to the third dot in a second direction perpendicular to the first direction, the second dot is located adjacent to the fourth dot in the second direction, the third dot is located adjacent to the fourth dot in the first direction, a dot other than the first dot, the second dot, the third dot, and the fourth dot of the dot pattern is the fifth dot, The projection method, wherein the first dot is located approximately at the center of the first image.

2. The dot pattern has M dots arranged in the first direction, When the number M is an even number, the position of the first dot in the first direction is a dot located M / 2th from the dot at either end in the first direction; When the number M is an odd number, the position of the first dot in the first direction is a dot located at the (M+1) / 2th position counting from a dot at either end in the first direction; The projection method according to claim 1 , wherein the M number is an integer equal to or greater than 3.

3. The dot pattern has N dots arranged in the second direction, When the number N is an even number, the position of the first dot in the second direction is a dot located at the N / 2th position counting from the dot at either end in the second direction; When the number N is an odd number, the position of the first dot in the second direction is a dot located at the (N+1) / 2th position counting from a dot at either end in the second direction, 3. The projection method according to claim 1, wherein said N is an integer of 3 or more.

4. The difference between a first dot number, which is the number of dots between a first side of the first image and the first dot, and a second dot number, which is the number of dots between a second side of the first image opposite to the first side in the first direction and the first dot, is: The projection method according to any one of claims 1 to 3, wherein the third dot number, which is the number of dots between the first side and the fifth dot arranged in the same row as the first dot, is smaller than the difference between the fourth dot number, which is the number of dots between the second side and the fifth dot.

5. The difference between a fifth dot number, which is the number of dots between a third side of the first image and the first dot, and a sixth dot number, which is the number of dots between a fourth side of the first image opposite the third side in the second direction and the first dot, is:

5. A projection method according to claim 1, wherein the number of dots between the third side and the fifth dot arranged in the same row as the first dot is smaller than the difference between the seventh dot number, which is the number of dots between the third side and the fifth dot, and the eighth dot number, which is the number of dots between the fourth side and the fifth dot.

6. calculating a matrix for converting dots of the dot pattern included in the first image into positions of dots of the dot pattern captured in the captured image; Associating the dots of the dot pattern captured in the captured image with the dots of the dot pattern included in the first image includes: The projection method according to claim 1 , wherein the dots of the dot pattern captured in the captured image are associated with the dots of the dot pattern included in the first image based on the matrix.

7. 7. The projection method of claim 6, wherein the matrix converts the first dot, the second dot, the third dot, and the fourth dot contained in the first image into the positions of the first dot, the second dot, the third dot, and the fourth dot captured in the captured image.

8. a projection unit that projects a first image including a dot pattern; an image capturing unit that captures the first image projected by the projection unit; a control unit that associates dots of the dot pattern included in the captured image captured by the imaging unit with dots of the dot pattern included in the first image, the dot pattern includes a first dot, a second dot, a third dot, a fourth dot, and a fifth dot, the display mode of the first dot is a first display mode, the display mode of the second dot is a second display mode different from the first display mode, a display mode of the third dot is a third display mode different from the first display mode and the second display mode, the display mode of the fourth dot is a fourth display mode different from the first display mode, the second display mode, and the third display mode, a display mode of the fifth dot is a fifth display mode different from the first display mode, the second display mode, the third display mode, and the fourth display mode, the first dot is located adjacent to the second dot in a first direction and adjacent to the third dot in a second direction perpendicular to the first direction, the second dot is located adjacent to the fourth dot in the second direction, the third dot is located adjacent to the fourth dot in the first direction, a dot other than the first dot, the second dot, the third dot, and the fourth dot of the dot pattern is the fifth dot, The first dot is located approximately at the center of the first image.

Images