Pattern image output method, projector, and program

Abstract

To solve the problem in which: in the prior art, in one pattern image, brightness continuously changes for every adjacent pixel; and therefore, the influence of noise increases erroneous detection of a phase value, which may cause mixing between a certain pixel and a pixel adjacent to the pixel.SOLUTION: A pattern image output method is to output a pattern image used in a phase shift method including a first area including a plurality of pixels adjacent to each other and having first brightness based at least on a first phase in a first period, and a second area different from the first area and including a plurality of images adjacent to each other and having second brightness based at least on a second phase different from the first phase in the first period.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a pattern image output method, a projector, and a program. [Background technology]

[0002] Conventionally, a technique has been used in which a projected image projected on a projection surface and a captured image obtained by capturing the projected image are associated with each other by image processing using a phase shift method.

[0003] In the technology of Patent Document 1, first, the lighting control device causes the projection device to project a stripe pattern whose brightness changes periodically in a first direction onto the projection area. The lighting control device also acquires a captured image from a camera that captured the projection image. The lighting control device associates the projection image with the captured image for the first direction using a phase shift method. Next, the lighting control device causes the projection device to project a stripe pattern whose brightness changes periodically in a second direction perpendicular to the first direction onto the projection area. Similarly, the lighting control device acquires a captured image from the camera that captured the projection image. The lighting control device associates the projection image with the captured image for the second direction using a phase shift method. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-271580 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, the brightness of adjacent pixels in one pattern changes continuously, which can cause a pixel to be confused with its adjacent pixels due to the influence of noise. [Means for solving the problem]

[0006] A pattern image output method according to one embodiment of the present invention is a method for outputting a pattern image for use in a phase shift method, the pattern image including a first region having a first brightness based at least on a first phase in a first period and including a plurality of adjacent pixels, and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase in the first period and including a plurality of adjacent images.

[0007] Moreover, a projector according to one embodiment of the present invention includes an optical device and at least one processor, and the at least one processor controls the optical device to project a pattern image used in a phase shifting method, the pattern image including a first region having a first brightness based at least on a first phase having a first period and including a plurality of adjacent pixels, and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase having the first period, including a plurality of adjacent images.

[0008] Furthermore, a program according to one embodiment of the present invention is a program that causes a computer to execute the following process: outputting a pattern image for use in a phase shifting method, the pattern image including a first region having a first brightness based at least on a first phase having a first period and including a plurality of adjacent pixels; and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase having the first period, including a plurality of adjacent images. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of a projector 10 according to a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a pattern image. [Diagram 3] FIG. 4 is a diagram showing an example of a pattern image. [Figure 4]4 is a flowchart showing the operation of the projector 10. [Diagram 5] FIG. 4 is a diagram showing an example of a pattern image. [Figure 6] FIG. 4 is a diagram showing an example of a pattern image. [Figure 7] FIG. 4 is a diagram showing an example of a pattern image. [Figure 8] FIG. 4 is a diagram showing an example of a pattern image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, a pattern image output method, a projector, and a program according to the embodiment will be described with reference to the drawings. In each drawing, the dimensions and scale of each part are appropriately different from the actual ones. In addition, since the embodiments described below are preferred specific examples, various technically preferable limitations are attached, but the scope of the present disclosure is not limited to these forms unless otherwise specified in the following description to limit the present disclosure.

[0011] 1: First embodiment 1-1: Configuration of the embodiment 1 is a block diagram showing the configuration of a projector 10 according to the first embodiment. The configuration of the projector 10 will be described below with reference to FIG.

[0012] Projector 10 includes a projection device 11, an imaging device 12, a processing device 13, a storage device 14, and a communication device 15. The elements of projector 10 are connected to each other via one or more buses for communicating information. Furthermore, each element of projector 10 is composed of one or more devices, and some elements of projector 10 may be omitted. Projector 10 is an example of a "first projector."

[0013] The projection device 11 is a device that projects a projection image onto a projection surface such as a screen or a wall. The projection device 11 includes, for example, a light source, a liquid crystal panel, and a projection lens, modulates light from the light source using the liquid crystal panel, and projects the modulated light onto a projection surface such as a screen or a wall via the projection lens. In particular, in this embodiment, the projection device 11 projects a pattern image generated by a pattern generating unit 131 described later onto the projection surface. The projection device 11 is an example of an "optical device." In the above, a transmissive liquid crystal light valve or a reflective liquid crystal light valve may be used as the liquid crystal panel. In addition, a digital mirror device that modulates light emitted from a light source by controlling the emission direction of incident light for each micromirror as a pixel may be used. In addition, the configuration is not limited to a configuration having multiple light modulation devices for each color light, and a configuration in which multiple color lights are modulated in a time-division manner by one light modulation device may be used.

[0014] The imaging device 12 captures a display image that is displayed by being projected onto the projection surface by the projection device 11. The imaging device 12 also outputs the captured image to the processing device 13. In particular, in this embodiment, the imaging device 12 captures a pattern image that is projected onto the projection surface by the projection device 11, and outputs the captured pattern image to the processing device 13. The imaging device 12 may be a normal digital camera or an image sensor.

[0015] The processing device 13 is a processor that controls the entire projector 10, and is composed of, for example, a single chip or multiple chips. The processing device 13 is composed of, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 13 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 13 executes various processes in parallel or sequentially. The processing device 13 is an example of a "computer."

[0016] The storage device 14 is a recording medium readable by the processing device 13, and stores a plurality of programs including the control program PR1 executed by the processing device 13. The control program PR1 may be transmitted from another device that manages the projector 10 via a communication network (not shown). The storage device 14 may be configured with at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), and a Random Access Memory (RAM). The storage device 14 may be called a register, a cache, a main memory, or a primary storage device.

[0017] The communication device 15 is hardware serving as a transmitting / receiving device for communicating with other devices. In particular, in this embodiment, the communication device 15 is also called, for example, a network device, a network controller, a network card, or a communication module.

[0018] The processing device 13 functions as a pattern generation unit 131, a projection control unit 132, an imaging control unit 133, a first acquisition unit 134, a frequency analysis unit 135, a correspondence relationship generation unit 136, a measurement value calculation unit 137, a correction value calculation unit 138, a second acquisition unit 139, and an image correction unit 140 by reading and executing the control program PR1 from the memory device 14.

[0019] The pattern generating unit 131 generates a pattern image used in the phase shift method. The pattern image will be described in detail below.

[0020] When performing the phase shift method according to this embodiment, the number of shifts is set to N. That is, in the phase shift method according to this embodiment, the projection device 11 sequentially projects N pattern images. Also, the imaging device 12 captures the N pattern images that are sequentially projected. The processing device 13 acquires phase values ​​by performing frequency analysis on the time change in brightness in the N captured images. Projecting a pattern image by the projection device 11 is an example of "outputting a pattern image".

[0021] In this specification, the coordinate system on the liquid crystal panel of the projection device 11 is called the "panel coordinate system." The positions of the lattice points obtained by equally dividing the liquid crystal panel in the horizontal direction by r points and the vertical direction by s points are defined as the measurement positions of the brightness. In addition, a rectangular area with each measurement position as its center is defined as I. i,j (1≦i≦r, 1≦j≦s). Each region includes a plurality of pixels adjacent to each other. FIG. 2 is a diagram showing an example of a pattern image on the liquid crystal panel. In the pattern image PP, region I i,j are spaced apart from each other and arranged in tiles, where I 1,1 is an example of a "first region". 2,1 is an example of a "second region." Furthermore, in the pattern image PP, region I i,j A region other than (1≦i≦r, 1≦j≦s), i.e., a region I i,j and other areas I i,jThe region RL located between and is an example of a "third region." The third region includes a plurality of pixels adjacent to each other, similar to the first and second regions. Note that in FIG. 2, r=14, s=8, but this is merely an example, and the values ​​of r and s are any integers of 2 or more. For example, as shown in FIG. 2, r=14, s=8 may be used, or r=19, s=9 may be used.

[0022] Here, the pattern generating unit 131 generates a pattern for each region I i,j For two phase values ​​θ i ,φ j Specifically, each phase value is assigned as θ i =2πx i / W,φ i =2πy j / H, where (x i ,y j ) are the coordinates of the grid point in the i-th row and j-th column in the panel coordinate system. W is the horizontal resolution of the liquid crystal panel. H is the vertical resolution of the liquid crystal panel. The horizontal resolution W of the liquid crystal panel is an example of a first period, and the vertical resolution H of the liquid crystal panel is an example of a second period.

[0023] In this case, the area I in the pattern image projected for n=0, 1, . . . , N-1 is i,j The brightness is determined by the following formula (1). f(i,j,n) = cos(θ i +2πn / N)+cos(φ j +4πn / N) Formula (1)

[0024] In FIG. 2, the first region, Region I 1,1 has a first brightness based at least on (θ1+2πn / N), which is a first phase in the first period. 2,1has a second brightness based at least on (θ2+2πn / N), which is a second phase in the first period and different from the first phase. The first brightness is based on (φ1+4πn / N), which is a third phase in the second period and different from the first period, in addition to the first phase. Meanwhile, the second brightness is based on (φ2+4πn / N), which is a fourth phase in the second period, in addition to the second phase. The third region, region RL, has a third brightness based on a fifth phase that is different from both the first phase and the second phase. The third brightness of region RL may be composed of a single color, such as black or white.

[0025] In practice, the difference between the first phase and the second phase is preferably, for example, an angle of 18° or more, which is equal to 360° divided by 20. Alternatively, the difference between the first phase and the second phase is preferably, for example, an angle of twice the allowable error or more.

[0026] Note that (a) to (h) in FIG. 3 are examples of N=8 pattern images corresponding to the formula (1).

[0027] In this embodiment, unlike the general phase shift method, the phase value θ i ,φ j (1≦i≦r, 1≦j≦s) take only discrete values ​​at predetermined intervals. As a result, the allowable error range of the detected phase value is, for example, (θ i-1 +θ i ) / 2<θ<(θ i +θ i+1 ) / 2 This is very wide, and erroneous detection of phase values ​​is unlikely to occur. i,jSince all pixels have the same phase value within the captured image of the pattern image, the frequency analysis unit 135 described later can perform spatial smoothing to remove noise within the captured image of the pattern image. This makes it easier for the frequency analysis unit 135 to reduce noise. Furthermore, the frequency analysis unit 135 described later can detect the phase value based only on the change in brightness of the pixels that make up the captured image of the pattern image. This means that the frequency analysis unit 135 described later does not require a threshold value for distinguishing colors, and erroneous detection of the phase value is reduced.

[0028] In FIG. 1, a projection control unit 132 causes a projection device 11 to project a pattern image generated by a pattern generating unit 131 onto a projection surface.

[0029] The imaging control unit 133 causes the imaging device 12 to capture the pattern image projected onto the projection surface.

[0030] The first acquisition unit 134 acquires, from the imaging device 12, a captured image obtained by capturing a pattern image.

[0031] The frequency analysis unit 135 performs a frequency analysis on the data indicating the captured image acquired by the first acquisition unit .

[0032] In this specification, the coordinate system in the captured image is referred to as the "camera coordinate system." The frequency analysis unit 135 performs a discrete Fourier transform on the time change in brightness of the coordinates (X, Y) in the camera coordinate system of the N captured images obtained by capturing the N pattern images that are projected sequentially. Specifically, the frequency analysis unit 135 performs a discrete Fourier transform on the time change in brightness of the coordinates (X, Y) in the captured image that accompanies the sequential projection of the N pattern images. As a result, the frequency analysis unit 135 calculates a phase value θ i ,φ j (1≦i≦r, 1≦j≦s) can be calculated.

[0033] Specifically, the brightness of the pixel at coordinate (X, Y) in the camera coordinate system in the captured image of the pattern image is expressed as a0, a1, . . . , a N-1In addition, the frequency analysis unit 135 performs a discrete Fourier transform on these N pieces of data to obtain values ​​b0, b1, . . . , b N-1 From the nature of the Fourier transform, each b n satisfies the following formula (2) and formula (3).

number

[0034] The frequency analysis unit 135 can calculate the phase value θ and the phase value φ by applying an inverse trigonometric function to the values ​​b1 and b2 after the Fourier transform.

number

[0035] The correspondence relationship generating unit 136 calculates the coordinates (X, Y) in the camera coordinate system in the captured image and the i and j calculated by the frequency analysis unit 135, based on which the area I on the liquid crystal panel in the panel coordinate system corresponds to the coordinates (X, Y) in the camera coordinate system in the captured image. i,j Request.

[0036] The measurement value calculation unit 137 calculates various measurement values ​​using the captured image acquired by the first acquisition unit 134 and the correspondence between the camera coordinate system and the panel coordinate system generated by the correspondence generation unit 136. The "captured image" here is not limited to the above-mentioned pattern image, and includes, for example, captured images generated by capturing an image of the projection surface by the imaging device 12 during geometric correction of the projector 10, during color correction of the projection image, and during normal use. In addition, the "measurement value" here may be, for example, one or more of the three-dimensional shape of the projection surface, the parallax between the projection lens of the projection device 11 and the imaging device 12, and color unevenness on the liquid crystal panel.

[0037] A correction value calculation unit 138 calculates various correction values ​​based on the measurement values ​​calculated by the measurement value calculation unit 137. The correction values ​​are used, for example, for the above-mentioned geometric correction or for correcting color unevenness in a projected image.

[0038] The second acquisition unit 139 acquires an image that is viewed by a user of the projector 10 during normal use from an external device via the communication device 15. The external device is configured with various image output devices such as a personal computer or a tablet. The external device includes, for example, a DVD (Digital Versatile Disc) player.

[0039] Image correction unit 140 corrects the image acquired by second acquisition unit 139 by setting various correction values ​​calculated by correction value calculation unit 138 in a correction circuit. Image correction unit 140 also outputs the corrected image to projection control unit 132. Projection control unit 132 causes projection device 11 to project the image acquired from image correction unit 140 during normal use.

[0040] 1-2: Operation of the embodiment 4 is a flowchart showing the operation of the projector 10. The operation of the projector 10 will be described below with reference to FIG.

[0041] In step S11, the processing device 13 functions as a pattern generating unit 131. The processing device 13 generates a pattern image used in the phase shift method.

[0042] In step S12, the processing device 13 functions as the projection control unit 132. The processing device 13 causes the projection device 11 to project the pattern image generated in step S11 onto the projection surface.

[0043] In step S13, the processing device 13 functions as an imaging control unit 133. The processing device 13 causes the imaging device 12 to capture the pattern image projected onto the projection surface by the projection device 11. The processing device 13 also functions as a first acquisition unit 134. The processing device 13 acquires, from the imaging device 12, a captured image obtained by capturing the pattern image.

[0044] In step S14, if the processing device 13 has projected and photographed all the pattern images (YES in S14), the processing device 13 executes the process of step S15. In step S14, if the processing device 13 has not yet finished projecting and photographing all the pattern images (NO in S14), the processing device 13 executes the process of step S11.

[0045] In step S15, the processing device 13 functions as a frequency analysis unit 135. The processing device 13 performs a discrete Fourier transform on the data indicating the captured image acquired by the first acquisition unit 134 in the time direction.

[0046] In step S16, the processing device 13 functions as the frequency analysis unit 135. The processing device 13 calculates i and j corresponding to each pixel of the coordinates (X, Y) in the camera coordinate system based on the result of the discrete Fourier transform in step S15.

[0047] In step S17, the processing device 13 functions as the correspondence relationship generating unit 136. The processing device 13 calculates the coordinate values ​​(X, Y) in the camera coordinate system and the area I on the liquid crystal panel in the panel coordinate system. i,j Generate a correspondence between

[0048] In step S18, the processing device 13 functions as the measurement value calculation unit 137. The processing device 13 calculates various measurement values ​​using the captured image acquired by the first acquisition unit 134 and the correspondence relationship generated in step S17.

[0049] In step S19, the processing device 13 functions as the correction value calculation unit 138. The processing device 13 calculates various correction values ​​based on the measurement values ​​calculated in step S18.

[0050] In step S20, the processing device 13 functions as the image correction unit 140. The processing device 13 corrects the image acquired from the external device by setting the various correction values ​​calculated in step S19 in a correction circuit.

[0051] 2: Variations The present disclosure is not limited to the above-described embodiments. Specific modified embodiments are exemplified below.

[0052] 2-1: Variation 1 In the above embodiment, the pattern generating unit 131 generates a pattern for each region I i,j For two phase values ​​θ i ,φ j However, the number of phase values ​​to be assigned to each region is not limited to two. For example, in the above embodiment, the pattern generating unit 131 equally divides the liquid crystal panel into r positions in the horizontal direction and s positions in the vertical direction, and assigns the jth row and ith column region to region I. i,j That is, the pattern generating unit 131 uses two index values, i and j, to generate a region I i,j However, the pattern generating unit 131 uses only one index value i to classify each area in the liquid crystal panel into area I i Furthermore, the pattern generating unit 131 may identify each region I i For one phase value θ i In this case, the pattern generating unit 131 may assign each of the regions I1, I2, . . . , I r θ1,θ2,...,θ r of, θi=2πi / r In addition, the area I in the pattern image projected for n=0, 1, . . . , N-1 is iThe brightness is determined by the following formula (4). f(i,n) = cos(θ i +2πn / N) Formula (4)

[0053] Note that (a) to (c) of FIG. 5 are examples of pattern images where N=3, corresponding to the formula (4).

[0054] 2-2: Variation 2 Alternatively, the pattern generating unit 131 may detect the phase value in the x direction and the phase value in the y direction separately, as in a general shift method. In order to detect the phase value in the x direction, the pattern generating unit 131 may detect the phase value in the x direction by dividing the region I i,j The brightness is determined by the following formula (5). f x (i,n) = cos(θ i +2πn / N) Formula (5) On the other hand, to detect the phase value in the y direction, the region I i,j The brightness is determined by the following formula (6). f y (j,n)=cos(φ j +2πn / N) Formula (6) 6(a) to 6(c) are examples of pattern images where N=3, which correspond to formula (5). Fig. 7(a) to 7(c) are examples of pattern images where N=3, which correspond to formula (6).

[0055] 2-3: Variation 3 In the above embodiment, one projector 10 projects N pattern images PP, and the pattern images PP are each divided into r×s rectangular regions I i,j (1≦i≦r, 1≦j≦s). However, when multiple projectors 10 are present, each of the multiple projectors 10 is assigned to one area I i,j may be used to identify the projection range of each projector 10 in the camera coordinate system in the captured image.

[0056] Specifically, in this third variant, the number of the multiple projectors 10 is K, and the phase value to be assigned to the kth projector 10 where k = 0, 1,..., K-1 is defined as θk = 2πk / K.

[0057] If the number of captured images of a pattern is N, the brightness of the pattern image projected at n=0, 1, . . . , N-1 is determined by the following formula (7). f(n) = cos(θ k +2πn / N) Formula (7)

[0058] As in the above embodiment, the projection device 11 sequentially projects these N pattern images. The imaging device 12 captures the N pattern images that are sequentially projected. The processing device 13 acquires the phase value θ by frequency analyzing the time change in brightness in the N captured images. The processing device 13 also acquires the θ that is closest to the acquired phase value θ at the coordinates (X, Y) in the camera coordinate system in the captured image. k Based on this, the k-th projector 10 that captured the pixel at the coordinates (X, Y) is derived. Note that (a) to (c) in Fig. 8 are an example of N=3 pattern images corresponding to the formula (7).

[0059] In the present modified example 3, when the k=1st projector 10 is defined as the “first projector” and the k=2nd projector 10 is defined as the “second projector”, the first projector is, for example, a projector in the first region I 1,1 The second projector projects a first pattern image corresponding to the second region I 2,1 A second pattern image corresponding to the first pattern image is projected.

[0060] 2-4: Variation 4 In the above embodiment, the function of the processing device 13 included in the projector 10 may be realized by an external device of the projector 10. The processing device 13 as the external device of the projector 10 is, for example, a personal computer or a tablet. For example, the external device may execute a function corresponding to the pattern generating unit 131 among the functional blocks of the processing device 13, transmit a pattern image generated by the external device to the projector 10, and the projector 10 may acquire the pattern image transmitted from the external device. Furthermore, the function of the processing device 13 included in the projector 10 may be realized as an application that can be distributed via a communication network not shown. The external device is an example of a "computer." Transmitting a pattern image generated by the external device to the projector 10 is an example of "outputting a pattern image."

[0061] 2-5: Variation 5 In the above embodiment, the pattern generating unit 131 generates a pattern image. However, instead of including the pattern generating unit 131, the processing device 13 may acquire a pattern image stored in the storage device 14.

[0062] 2-6: Variation 6 In the above embodiment, the projector 10 has the built-in imaging device 12, but the imaging device 12 may be an external device of the projector 10. The imaging device 12 as an external device of the projector 10 may be communicably connected to the projector 10 via an interface such as a USB, for example.

[0063] 3: Summary of this disclosure The following is a summary of this disclosure. (Supplementary Note 1) A method for outputting a pattern image for use in a phase shifting method, the pattern image including a first region having a first brightness based at least on a first phase in a first period and including a plurality of adjacent pixels, and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase in the first period and including a plurality of adjacent images.

[0064] The above pattern image output method suppresses erroneous detection of phase values ​​due to the influence of noise, and furthermore, the confusion of a pixel with its neighboring pixels. Specifically, in the above pattern image, pixels in the same region have the same phase value. Therefore, the projector can perform spatial smoothing to remove noise in the captured image. Therefore, the projector can be less susceptible to the influence of noise when performing the phase shift method.

[0065] (Supplementary Note 2) The method for outputting a pattern image according to Supplementary Note 1, wherein the first brightness is based on the first phase as well as a third phase in a second period different from the first period, and the second brightness is based on the second phase as well as a fourth phase in the second period.

[0066] According to the above-mentioned method for outputting a pattern image, the first brightness is based on the first phase and the third phase. Also, the second brightness is based on the second phase and the fourth phase. Therefore, the projector can measure the phase value in the x direction and the phase value in the y direction by performing the phase shift method once.

[0067] (Supplementary Note 3) The method for outputting a pattern image according to Supplementary Note 1 or Supplementary Note 2, wherein outputting the pattern image includes projecting the pattern image using a first projector.

[0068] By using the above-described method for outputting a pattern image, the projector can reduce the influence of noise when executing the phase shift method using one projector 10.

[0069] (Supplementary Note 4) The pattern image output method of Supplementary Note 1 or Supplementary Note 2, wherein the pattern image includes a first pattern image corresponding to the first region and a second pattern image corresponding to the second region, and outputting the pattern image includes projecting the first pattern image using a first projector and projecting the second pattern image using a second projector.

[0070] By using the above-described method for outputting a pattern image, the first projector projects the first pattern image, and the second projector projects the second pattern image. Therefore, when projection is performed by multiple projectors, the projector 10 can identify the projection range of each projector on the projection surface.

[0071] (Supplementary Note 5) The method for outputting a pattern image according to any one of Supplementary Note 1 to Supplementary Note 4, wherein the first phase and the second phase differ from each other by at least 18 degrees.

[0072] By using the above-mentioned pattern image output method, the first phase and the second phase differ from each other by at least 18 degrees. Therefore, when the projector executes the phase shift method, the phase values ​​corresponding to each region are discrete values ​​at a predetermined interval, which increases the tolerance for error and reduces false detections.

[0073] (Supplementary Note 6) The method for outputting a pattern image according to any one of Supplementary Note 1 to Supplementary Note 5, wherein the first area and the second area are spaced apart.

[0074] When the projector executes the phase shift method by using the above-described pattern image output method, the regions are spaced apart, so that the tolerance for error is increased and false detections can be reduced.

[0075] (Supplementary Note 7) A method for outputting a pattern image according to any one of Supplementary Note 1 to Supplementary Note 6, further comprising a third region between the first region and the second region, the third region having a third brightness based on a fifth phase different from both the first phase and the second phase, and including a plurality of pixels adjacent to each other, the third region being different from the first region and the second region.

[0076] According to the above-described pattern image output method, when the projector performs the phase shift method, the third area is located between the first area and the second area, so that the tolerance for error is increased and false detections can be reduced.

[0077] (Supplementary Note 8) A projector that includes an optical device and at least one processor, wherein the at least one processor controls the optical device to project a pattern image used in a phase shifting method, the pattern image including a first region having a first brightness based at least on a first phase having a first period and including a plurality of adjacent pixels, and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase having the first period and including a plurality of adjacent images.

[0078] The above projector suppresses false detection of phase values ​​due to the influence of noise, and furthermore, the confusion of a pixel with its neighboring pixels. Specifically, in the above pattern image, pixels in the same region have the same phase value. Therefore, the projector can perform spatial smoothing in the captured image to remove noise. Therefore, the projector can be less susceptible to the influence of noise when performing the phase shift method.

[0079] (Supplementary Note 9) A program that causes a computer to execute the process of outputting a pattern image for use in a phase shifting method, the pattern image including a first region having a first brightness based at least on a first phase having a first period and including a plurality of adjacent pixels, and a second region different from the first region having a second brightness different from the first phase and based at least on a second phase having the first period and including a plurality of adjacent images.

[0080] The above program suppresses false detection of phase values ​​due to the influence of noise, and furthermore, the confusion of a pixel with its neighboring pixels. Specifically, in the above pattern image, pixels in the same region have the same phase value. Therefore, the projector can perform spatial smoothing in the captured image to remove noise. Therefore, the projector can be less susceptible to the influence of noise when performing the phase shift method. [Explanation of symbols]

[0081] 10...projector, 11...projection device, 12...imaging device, 13...processing device, 14...storage device, 15...communication device, 131...pattern generation unit, 132...projection control unit, 133...imaging control unit, 134...first acquisition unit, 135...frequency analysis unit, 136...correspondence relationship generation unit, 137...measurement value calculation unit, 138...correction value calculation unit, 139...second acquisition unit, 140...image correction unit, PR1...control program

Claims

1. a first region including a plurality of pixels adjacent to each other, the first region having a first brightness based at least on a first phase in a first period; a second region different from the first region, the second region having a second brightness based at least on a second phase in the first period and different from the first phase, the second region including a plurality of pixels adjacent to each other; Outputs a pattern image used in the phase shifting method, including How to output the pattern image.

2. the first brightness is based on the first phase and a third phase in a second period different from the first period; the second brightness is based on a fourth phase in the second period in addition to the second phase; The pattern image output method according to claim 1 .

3. outputting the pattern image includes projecting the pattern image using a first projector; 3. The pattern image output method according to claim 1.

4. the pattern image includes a first pattern image corresponding to the first region and a second pattern image corresponding to the second region; outputting the pattern image projecting the first pattern image using a first projector; projecting the second pattern image using a second projector; Including, 3. The pattern image output method according to claim 1.

5. the first phase and the second phase differ from each other by at least 18 degrees; 3. The pattern image output method according to claim 1.

6. The first region and the second region are spaced apart.

3. The pattern image output method according to claim 1.

7. a third region between the first region and the second region, the third region having a third brightness based on a fifth phase different from both the first phase and the second phase, the third region including a plurality of pixels adjacent to each other, the third region being different from the first region and the second region; 3. The pattern image output method according to claim 1.

8. an optical device; at least one processor; The at least one processor By controlling the optical device, a pattern image used in a phase shifting method is projected, the pattern image including a first region having a first brightness based at least on a first phase having a first period and including a plurality of pixels adjacent to each other, and a second region having a second brightness based at least on a second phase different from the first phase and having the first period and including a plurality of pixels adjacent to each other, the second region being different from the first region. projector.

9. and outputting a pattern image used in a phase shifting method, the pattern image including: a first region having a first brightness based at least on a first phase having a first period and including a plurality of pixels adjacent to each other; and a second region different from the first region having a second brightness based at least on a second phase different from the first phase and having the first period and including a plurality of pixels adjacent to each other. A program that a computer runs.

Images