Projection method and projector

Abstract

Provided are a projection method and a projector capable of correcting distortion of an image with high accuracy even for a projection surface of a complex shape. A control section (60) of a projector (1) performs the following processing: receives an operation to change the positions of the vertices of a first pattern image (200) projected onto a projection surface (7), deforms the shape of a second pattern image (300) including a plurality of points based on the operation; projects the second pattern image (300) onto the projection surface (7); and generates second correction data that corrects the second pattern image (300) in a manner to correct the positions of the plurality of points based on a captured image obtained by capturing the projection surface (7) onto which the second pattern image (300) is projected, and projects the image corrected using the generated correction data onto the projection surface (7).

Description

TECHNICAL FIELD

[0001] The present application relates to a projection method and a projector. BACKGROUND

[0002] Conventionally, a technique of correcting distortion of an image displayed on a projection surface is known.

[0003] For example, Patent Literature 1 discloses a projection-type image display device that generates a correction image signal in which distortion of a projection image is corrected, according to a change of four corner correction points determined on the projection image projected onto a projection surface, and causes a similar distortion of an image according to the generated correction image signal.

[0004] Patent Literature 1: Japanese Patent Application Publication No. 2011-248185

[0005] However, there is a demand for high-precision correction of distortion of an image even for a projection surface of a more complex shape. SUMMARY

[0006] The projection method of the present disclosure includes: projecting a first image onto a projection surface; accepting an operation of changing a position of a vertex of the first image; deforming a shape of a second image including a plurality of first graphics based on the operation; projecting the second image onto the projection surface; acquiring a captured image obtained by capturing the projection surface onto which the second image is projected; generating correction data that corrects the second image in a manner of correcting positions of the plurality of first graphics based on the captured image; and projecting an image corrected using the correction data onto the projection surface.

[0007] The projector of the present disclosure includes: a projection section that projects an image onto a projection surface; an acceptance section that accepts an operation; and a control section that performs the following processing: when an operation of changing a position of a vertex of a first image projected onto the projection surface is accepted by the acceptance section, deforming a shape of a second image including a plurality of first graphics based on the operation; projecting the second image onto the projection surface by the projection section; acquiring a captured image obtained by capturing the projection surface onto which the second image is projected; generating correction data that corrects the second image in a manner of correcting positions of the plurality of first graphics based on the captured image; and projecting an image corrected using the correction data onto the projection surface by the projection section. BRIEF DESCRIPTION OF DRAWINGS

[0008] Figure 1 is a block diagram showing the structure of a projector.

[0009] Figure 2 is a diagram showing the structure of a projection section.

[0010] Figure 3 is a diagram showing a projection area of a projection surface.

[0011] Figure 4 is a diagram for explaining a method of calculating a radius of a point.

[0012] Figure 5 is a diagram showing a range of a panel area capable of drawing a first pattern image.

[0013] Figure 6 is a diagram for explaining a range of a panel area capable of drawing a point.

[0014] Figure 7 is a diagram showing a first pattern image.

[0015] Figure 8 is a diagram showing a first pattern image.

[0016] Figure 9 is a diagram showing a first pattern image displayed on a projection surface.

[0017] Figure 10 is a diagram showing a second pattern image.

[0018] Figure 11 is a diagram showing a second pattern image after deformation.

[0019] Figure 12 is a diagram showing a second pattern image after deformation displayed on a projection surface.

[0020] Figure 13 is a diagram showing a first deformation example of a first pattern image.

[0021] Figure 14 is a diagram showing a second deformation example of a first pattern image.

[0022] Figure 15 is a flowchart showing an operation of a projector.

[0023] Explanation of Reference Signs

[0024] 1: projector; 3: image supply device; 5: remote controller; 7: projection surface; 9: projection area; 10: remote controller light receiving section; 20: communication I / F; 30: imaging section; 41: image processing section; 43: frame memory; 50: projection section; 51: light source; 52: light modulation device; 53, 53R, 53G, 53B: liquid crystal panel; 55, 55R, 55G, 55B: panel area; 57: panel drive section; 59: optical unit; 60: control section; 70: storage section; 71: control program; 80: processor; 200: first pattern image; 205: frame; 210: vertex pattern; 211: first vertex pattern; 212: second vertex pattern; 213: third vertex pattern; 214: fourth vertex pattern; 230: operation pattern; 231: first operation pattern; 232: second operation pattern; 233: third operation pattern; 234: fourth operation pattern; 250: guide display; 260: arrow image; 300: second pattern image; 310: dot pattern; 330: detection point; 331: first dot; 332: second dot; 333: third dot; 334: fourth dot; 335: black dot. DETAILED DESCRIPTION

[0025] 1. Structure of projector

[0026] Figure 1 is a block diagram showing the structure of the projector 1.

[0027] The projector 1 is a device that generates image light from image data supplied from the image supply device 3 and image data stored in the storage section 70 of the projector 1, and projects the generated image light onto a projection surface 7 after amplifying the image light. The projection surface 7 can be, for example, a screen, or a wall or a whiteboard in a room. Hereinafter, the image data supplied from the image supply device 3 and the image data stored in the storage section 70 of the projector 1 will be referred to as display image data.

[0028] The projector 1 has a remote controller light receiving section 10, a communication interface 20, an imaging section 30, an image processing section 41, a frame memory 43, a projection section 50, and a control section 60. Hereinafter, the interface will be simply referred to as I / F.

[0029] The remote controller 5 and the remote controller light receiving section 10 correspond to a reception section. The remote controller light receiving section 10 receives an infrared signal transmitted from the remote controller 5. The remote controller light receiving section 10 decodes the received infrared signal, and generates an operation signal corresponding to the infrared signal. The operation signal generated here is a signal corresponding to a button of the remote controller 5 operated by a user. The remote controller light receiving section 10 outputs the generated operation signal to the control section 60.

[0030] The communication I / F 20 is a communication device and is wiredly connected to the image supply device 3. In the present embodiment, a case where the projector 1 is wirelessly connected to the image supply device 3 will be described, but the projector 1 can be wirelessly connected to the image supply device 3. The communication I / F 20 outputs the display image data received from the image supply device 3 to the image processing section 41.

[0031] The imaging section 30 has an imaging lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), and a data processing circuit. The imaging section 30 is, for example, a camera head. The imaging optical system, the imaging element, and the data processing circuit are omitted from the drawing. The field angle of view of the imaging section 30 includes the entire projection surface 7. The imaging section 30 generates an imaging image by imaging the projection surface 7. The imaging section 30 outputs the generated imaging image to the control section 60. The control section 60 temporarily stores the input imaging image in the storage section 70.

[0032] The image processing section 41 is connected to a frame memory 43. The image processing section 41 expands the display image data input from the communication I / F 20 in the frame memory 43 by 1 frame. The frame memory 43 has a plurality of memory banks. Each memory bank has a storage capacity capable of expanding 1 frame of display image data. The frame memory 43 is, for example, constituted by an SDRAM (Synchronous Dynamic Random Access Memory).

[0033] The image processing section 41 performs image processing such as resolution conversion processing or size adjustment processing, correction of distortion aberration, shape correction processing, digital zoom processing, adjustment of the hue or brightness of an image, and the like on the display image data expanded in the frame memory 43. The image processing section 41 performs the image processing designated by the control section 60, and performs the image processing using the parameters input from the control section 60 as necessary. In addition, the image processing section 41 can of course perform a plurality of the above-mentioned image processing in combination. The image processing section 41 reads out the display image data after the image processing from the frame memory 43 and outputs it to the light modulation device 52.

[0034] The image processing section 41 and the frame memory 43 are constituted by, for example, an integrated circuit. The integrated circuit includes an LSI, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-chip), and the like. In addition, a part of the structure of the integrated circuit can include an analog circuit, or can be a structure in which the control section 60 and the integrated circuit are combined.

[0035] Figure 2 FIG. 6 is a diagram showing the structure of the projection section 50.

[0036] Reference Signs List Figure 2 The structure of the projection section 50 will be described.

[0037] The projection section 50 has a light source 51, a light modulation device 52, and an optical unit 59. The light modulation device 52 of the present embodiment has three transmissive liquid crystal panels 53R, 53G, 53B corresponding to the three colors of red, green, and blue, and a panel drive section 57 that drives these liquid crystal panels 53R, 53G, 53B, as light modulation elements. The panel drive section 57 is, for example, a drive circuit. In addition, R is an abbreviation for Red, G is an abbreviation for Green, and B is an abbreviation for Blue. Hereinafter, in the case of collectively referring to the liquid crystal panels 53R, 53G, 53B possessed by the projector 1, it is expressed as the liquid crystal panel 53. The light modulation elements possessed by the light modulation device 52 of the present embodiment are not limited to the transmissive liquid crystal panels 53R, 53G, 53B, and can be, for example, a reflective liquid crystal panel, or a digital micromirror device (DMD).

[0038] The light source 51 has a discharge-type light source lamp such as an ultrahigh-pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light-emitting diode or a semiconductor laser. Light emitted from the light source 51 is incident on the liquid crystal panel 53. The liquid crystal panels 53R, 53G, and 53B are each composed of a transmissive liquid crystal panel or the like in which liquid crystal is enclosed between a pair of transparent substrates. The liquid crystal panel 53R modulates red light, the liquid crystal panel 53G modulates green light, and the liquid crystal panel 53B modulates blue light. A panel region 55 composed of a plurality of pixels arranged in a matrix is formed in each of the liquid crystal panels 53. The panel region 55 formed in the liquid crystal panel 53R is denoted as the panel region 55R, the panel region 55 formed in the liquid crystal panel 53G is denoted as the panel region 55G, and the panel region 55 formed in the liquid crystal panel 53B is denoted as the panel region 55B. The panel region 55 corresponds to a drawing region of the light modulating device 52 that draws an image.

[0039] The display image data output from the image processing section 41 is input to the panel drive section 57. The panel drive section 57 applies a drive voltage corresponding to the input display image data to each pixel of the panel region 55, and sets each pixel to a light transmittance corresponding to the display image data. Light emitted from the light source 51 is modulated by the panel region 55 of the liquid crystal panel 53, and image light corresponding to the display image data is formed for each of red light, green light, and blue light. The image light of each color formed is synthesized by a color synthesis optical system not shown to become image light representing a color image. The optical unit 59 has a projection lens or the like, and enlarges and projects the image light modulated by the liquid crystal panel 53 to the projection surface 7.

[0040] The control section 60 is a computer device having a storage section 70 and a processor 80.

[0041] The storage section 70 has a volatile memory such as a RAM (Random Access Memory) and a nonvolatile memory such as a ROM (Read Only Memory). The RAM is used for temporary storage of various data and the like, and the ROM stores a control program 71 used in the operation control of the projector 1, various setting information. In the setting information, for example, there are included information of a point number set by a user operating the remote controller 5, information of a panel resolution of the panel region 55, and the like. The information of the point number and the information of the panel resolution will be described later.

[0042] The processor 80 is an arithmetic processing device composed of a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The processor 80 controls each part of the projector 1 by executing the control program 71.

[0043] The control section 60 causes the image processing section 41 to process the display image data received by the communication I / F 20. At this time, the control section 60 instructs the image processing section 41 of the image processing to be performed by the image processing section 41, or outputs to the image processing section 41 a parameter used in the processing by the image processing section 41. In addition, the control section 60 controls the light source 51, the panel driving section 57 of the projection section 50, causes the projection section 50 to generate image light based on the display image data processed by the image processing section 41, and causes the projection surface 7 to project the generated image light.

[0044] Figure 3 is a view showing the projection region 9 of the projection surface 7.

[0045] The projector 1 projects the image light onto the projection surface 7, thereby displaying a display image based on the display image data on the projection surface 7. The region of the projection surface 7 onto which the image light is projected is referred to as the projection region 9. Figure 3 is a view showing the projection region 9 in a case where the display image data is drawn on the entire face of the panel region 55 of the liquid crystal panel 53.

[0046] In addition, the control section 60 starts a quick corner correction process and a point correction process when an operation signal instructing the start of the distortion correction is input from the remote control light receiving section 10.

[0047] The quick corner correction process is a process of adjusting the positions of the four corners of the display image displayed on the projection surface 7, and correcting the shape of the display image to a rectangle.

[0048] The point correction process is a process of correcting the distortion of the display image due to the distortion or unevenness of the projection surface 7, or the like.

[0049] First, the control section 60 determines the radius r of a dot used in the point correction. In the point correction, a pattern image in which a plurality of dots are arranged in a matrix is displayed on the projection surface 7, and the process is performed. In addition, in the quick corner correction, a pattern image is also displayed on the projection surface 7, and the process is performed. Hereinafter, the pattern image used in the quick corner correction will be referred to as a first pattern image 200, and the pattern image used in the point correction will be referred to as a second pattern image 300. The first pattern image 200 corresponds to the first image, and the second pattern image 300 corresponds to the second image.

[0050] In the point correction, the second pattern image 300 in which a plurality of dots are arranged in a matrix is displayed on the projection surface 7, and the displayed second pattern image 300 is captured by the capturing section 30. Further, since the dots are detected from the captured image generated by the capturing, and the correction data for correcting the position of the display image is generated based on the positions of the detected dots in the captured image, it is preferable that the value of the radius r of the dots be large.

[0051] First, the control section 60 reads out information of the number of dots set by the user operating the remote controller 5 and information of the panel resolution of the panel region 55 from the storage section 70. As for the information of the number of dots, it can be set in advance by the user operating the remote controller 5 or changed by the user operating the remote controller 5 after the first pattern image 200 and the second pattern image 300 are displayed on the projection surface 7. In this case, the control section 60 performs the process again from the calculation of the radius r of the dot.

[0052] The control section 60 calculates the radius r of the dot used in the second pattern image 300 based on the read information of the number of dots and the information of the panel resolution. The unit of the radius r is pixel.

[0053] Suppose that the panel region 55 is a landscape region, for example, 1080 in the vertical direction and 1920 in the horizontal direction. Further, suppose that the resolution of the vertical direction, which is the short side, is S. Further, suppose that the information of the number of dots set by the user is N in the vertical direction and M in the horizontal direction. N and M are arbitrary natural numbers.

[0054] Figure 4 is a diagram for explaining the calculation method of the radius r of the dot.

[0055] Figure 4 indicates the state in which the dots of the radius r are arranged. Suppose that the interval between the adjacent dots arranged is the radius r of the dot. The resolution S in the vertical direction is equal to the sum of N dots of the diameter 2r and N-1 intervals r, and thus the following equation (1) holds.

[0056] S = 2rN + r(N-1) ··· (1)

[0057] Thus, the radius r is found by the following equation (2).

[0058] r = S / (3N-1) ··· (2)

[0059] Figure 5 is a diagram indicating the range of the panel region 55 of the liquid crystal panel 53 capable of drawing the first pattern image 200.

[0060] When the radius r of the dot is calculated, the control section 60 generates the first pattern image 200 and displays the generated first pattern image 200 on the projection surface 7. The first pattern image 200 is drawn at a certain distance inward from each of the upper and lower ends and the left and right ends of the panel region 55 of the liquid crystal panel 53. Specifically, it is formed at a distance of the radius r inward from each of the upper and lower ends of the panel region 55. Similarly, the first pattern image 200 is formed at a distance of the radius r inward from each of the left and right ends of the panel region 55.

[0061] Figure 6is a view for explaining the range of the panel region 55 in which a point can be depicted. For Figure 6 For the point C1 shown, the center of the point C1 is located at a radius r inward from the upper end of the panel region 55. Also, for the point C1, the center of the point C1 is located at a radius r inward from the left end of the panel region 55 when viewing the drawing. Thus, the entire of the point C1 can be depicted within the panel region 55 of the liquid crystal panel 53, and the entire of the point C1 is displayed on the projection surface 7 when displayed on the projection surface 7.

[0062] In contrast, for the point C2 shown, the distance between the center of the point C2 and the upper end of the panel region 55 is less than the radius r. Also, the distance between the center of the point C2 and the right end of the panel region 55 when viewing the drawing is less than the radius r. Thus, Figure 6 Figure 6 A part of the range of the point C2 shown in hatching is not depicted in the panel region 55, and thus is not displayed on the projection surface 7. Thus, the control section 60 forms the first pattern image 200 of the radius r inward from each of the upper and lower ends and the left and right ends of the panel region 55 when calculating the radius r of the point.

[0063] Figure 7 and Figure 8 is a view showing the first pattern image 200.

[0064] Figure 7 The first pattern image 200 shown includes a vertex figure 210, an operation figure 230, and a guide display 250. The guide display 250 is a display that guides the user as to the operation content of the remote controller 5.

[0065] The vertex figure 210 corresponds to the second figure. The vertex figure 210 is a figure that is arranged at a position corresponding to four vertices of the range of the projection region 9 in which a point can be displayed, and includes four vertex figures, a first vertex figure 211, a second vertex figure 212, a third vertex figure 213, and a fourth vertex figure 214. The operation figure 230 is a figure that indicates the vertex figure 210 selected by the user, and includes four operation figures, a first operation figure 231, a second operation figure 232, a third operation figure 233, and a fourth operation figure 234. The first operation figure 231 corresponds to the first vertex figure 211, the second operation figure 232 corresponds to the second vertex figure 212, the third operation figure 233 corresponds to the third vertex figure 213, and the fourth operation figure 234 corresponds to the fourth vertex figure 214.

[0066] The user operates the remote controller 5 while visually confirming the first pattern image 200 displayed on the projection surface 7, and inputs the selection of the vertex figure 210 that adjusts the display position, and the direction and amount of movement that moves the vertex figure 210.

[0067] ​When the user operates the remote controller 5 to select a vertex as an object of adjustment of position, the display mode of the operation graphic 230 corresponding to the selected vertex is displayed in a different manner from the display modes of the other operation graphics 230. Figure 7 represents a state in which the display mode of the first operation graphic 231 is displayed in a different manner from the display modes of the other operation graphics 230.

[0068] Figure 8 is a view showing the display of the first pattern image 200 after the object vertex graphic 210 of adjustment of display position is selected.

[0069] When the object vertex graphic 210 of adjustment of display position is selected, the control section 60 displays, at the operation graphic 230 corresponding to the selected vertex graphic 210, an arrow image 260 indicating the direction in which the vertex graphic can be moved.

[0070] Figure 8 represents a state in which the arrow image 260 indicating the directions in which the first vertex graphic 211 can be moved (i.e., the right direction and the lower direction) is displayed at the first operation graphic 231.

[0071] Figure 9 is a view showing the first pattern image 200 displayed on the projection surface 7.

[0072] It is assumed that a rectangular graphic formed by connecting the centers of the four vertex graphics 210 with straight lines is displayed on the projection surface 7, and the deformation shown in Figure 7 is displayed as a trapezoidal graphic. Further, in order to simplify the explanation, the display of the operation graphics 230 and the guide display 250 is omitted in Figure 9 Figure 9

[0073] If the projector 1 is not directly opposite the projection surface 7, but is set obliquely with respect to the projection surface 7, the rectangular graphic shape is deformed. In Figure 9 , a case is shown in which the distance between the lower side position of the vertical direction of the projection surface 7 and the projector 1 is larger than the distance between the upper side position of the vertical direction of the projection surface 7 and the projector 1, and the upper base length of the displayed graphic is longer than the lower base length.

[0074] The user visually checks the projection surface 7 while operating the remote controller 5 so that the graphic formed by connecting the centers of the four vertex graphics 210 with straight lines becomes a rectangle. More specifically, the user operates the remote controller 5 to input an operation of selecting any of the first to fourth vertex graphics 211 to 214, and a moving direction and a moving amount of moving the position of the selected vertex graphic 210.

[0075] ​​The control section 60 selects any one of the vertex graphics 210 based on the operation signal input from the remote controller light-receiving section 10, and moves the position of the selected vertex graphic 210 in the direction indicated by the operation signal by the amount indicated by the operation signal. Figure 9 The positions of the four vertex graphics 210 before movement and the positions of the four vertex graphics 210 after movement are shown separately.

[0076] The control section 60 generates the first correction data based on the movement amount and the movement direction input by the remote controller 5 when changing the display positions of the vertex graphics 210. That is, the control section 60 generates the first correction data that moves the positions of the vertex graphics 210 before deformation to the positions of the vertex graphics 210 after deformation. The control section 60 generates the first correction data for the number of vertex graphics 210 whose display positions are moved by the user's operation.

[0077] Figure 10 is a diagram showing the second pattern image 300.

[0078] Here, the second pattern image 300 will be described. The second pattern image 300 has a dot pattern 310 in which a plurality of dots are arranged in a matrix shape. The radius of each dot is formed by the calculated radius r. Figure 10 The second pattern image 300 shown in the drawing has the dot pattern 310 of N rows vertically and M columns horizontally. N and M are integers of 3 or more.

[0079] In the approximate center of the dot pattern 310, four dots that are different from the other dots in display mode are arranged in two rows and two columns. These four dots are used for detection of position, and the positions of the other dots are determined based on the detected positions of the four dots.

[0080] Among the four dots arranged in two rows and two columns, the dot located at the upper left when viewing the drawing is referred to as the first dot 331, and the dot adjacent to the first dot 331 on the right side of the first dot 331 when viewing the drawing is referred to as the second dot 332. In addition, the dot adjacent to the first dot 331 on the lower side of the first dot 331 when viewing the drawing is referred to as the third dot 333. Furthermore, the dot adjacent to the second dot 332 on the lower side of the second dot 332 when viewing the drawing is referred to as the fourth dot 334. In the case of collectively referring to the first dot 331, the second dot 332, the third dot 333, and the fourth dot, the expression "detection dots 330" is used.

[0081] In addition, the dots in the dot pattern 310 of the second pattern image 300 other than the detection dots 330 are referred to as black dots 335. The detection dots 330 and the black dots 335 correspond to the first graphics.

[0082] In the present embodiment, the first point 331 is formed by red, the second point 332 is formed by blue, the third point 333 is formed by green, and the fourth point 334 is formed by white on a black background. The first point 331, the second point 332, the third point 333, and the fourth point 334 are formed by colors other than black of the black point 335 and by different colors, respectively. Further, in the present embodiment, the points are formed in different display manners by changing the colors of the first point 331, the second point 332, the third point 333, the fourth point 334, and the black point 335. The first point 331, the second point 332, the third point 333, the fourth point 334, and the black point 335 can be formed in different shapes, respectively.

[0083] Figure 11 is a view showing the deformed second pattern image 300. Further, Figure 12 is a view showing the deformed second pattern image 300 displayed on the projection surface 7.

[0084] The control section 60 deforms the shape of the second pattern image 300 on the basis of the generated first correction data after the first correction data is generated. That is, the position of the vertex of the second pattern image 300 is corrected by the corresponding first correction data. Thus, the second pattern image 300 is corrected so that the barycenter or center of the black point 335 located at the vertex of the second pattern image 300 is located at the barycenter or center of the vertex pattern 210 at the position of the corresponding vertex of the first pattern image 200. Figure 11 is a view showing the deformed second pattern image 300 drawn on the panel region 55. The control section 60 outputs the deformed second pattern image 300 to the image processing section 41. Then, the second pattern image 300 is displayed on the projection surface 7 by the projection section 50. Figure 12 is a view showing the deformed second pattern image 300 displayed on the projection surface 7.

[0085] When the deformed second pattern image 300 is displayed on the projection surface 7, the control section 60 instructs the photographing section 30 to perform photographing. The photographing section 30 performs photographing as instructed by the control section 60 to generate a photographed image. The photographing section 30 outputs the generated photographed image to the control section 60.

[0086] The control section 60 generates second correction data for correcting the deformation of the image on the basis of the input photographed image. The control section 60 first performs image analysis on the photographed image to detect the four detection points 330. Next, the control section 60 calculates the determinant of the projection transformation on the basis of the detection points 330 arranged in two rows and two columns. The determinant is the determinant of the transformation of the positions of the first point 331, the second point 332, the third point 333, and the fourth point 334 of the deformed second pattern image 300 to the positions of the first point 331, the second point 332, the third point 333, and the fourth point 334 of the photographed image.

[0087] Next, the control unit 60 uses the calculated determinant of the projective transformation to perform a projective transformation on the positions of each point included in the deformed second pattern image 300, and determines the point of the captured image based on the projective-transformed point positions. Specifically, the black point 335 included in the second pattern image 300 is associated with the black point 335 included in the captured image.

[0088] Next, the control unit 60 generates second correction data for correcting the positions of the points in the second pattern image 300 based on the points in the captured image. Specifically, the control unit 60 generates second correction data for correcting the positions of the corresponding points in the second pattern image 300 based on the amount of positional shift between the points in the captured image.

[0089] After generating the second correction data, the control unit 60 outputs the generated first and second correction data to the image processing unit 41. The image processing unit 41 corrects the display image data input from the communication interface 20 or read from the storage unit 70 based on the input first and second correction data, and outputs the corrected display image data to the projection unit 50. The projection unit 50 develops the display image based on the display image data corrected using the first and second correction data onto the panel area 55 of the liquid crystal panel 53. Light emitted from the light source 51 passes through the panel area 55, generating image light corresponding to the display image data. The generated image light is magnified by the optical unit 59 and projected onto the projection surface 7.

[0090] Figure 13 2 is a diagram showing a first modification example of the first pattern image 200 .

[0091] Figure 7 The first pattern image 200 shown displays a vertex graphic 210 , and the vertex graphic 210 indicates four vertices of the range of the projection area 9 where a dot can be displayed.

[0092] exist Figure 13 In the first modified example of the first pattern image 200 shown, the display of the vertex graphics 210 is omitted, and the first pattern image 200 is drawn on the panel area 55 so that the first pattern image 200 is displayed at a position spaced inward by a radius r from each of the upper, lower, left, and right sides of the panel area 55. In other words, the outer frame 205 constituting the first pattern image 200 indicates the range of the projection area 9 in which the dot can be displayed. The outer frame 205 corresponds to the frame image.

[0093] Figure 14 2 is a diagram showing a second modification of the first pattern image 200 .

[0094] exist Figure 14In the modification example of the first pattern image 200 shown in FIG. 1, a black image is drawn in the panel region 55 of the liquid crystal panel 53 outside the range of the projection region 9 in which the displayable dots are present. By drawing a black image outside the range of the projection region 9 in which the displayable dots are present, the user can recognize the range of the projection region 9 in which the displayable dots are present and the region other than the range.

[0095] 2. Operation of the projector

[0096] Figure 15 is a flowchart showing the operation of the projector 1.

[0097] Referring to Figure 15 The flowchart shown above explains the operation of the projector 1.

[0098] First, the control section 60 determines whether or not an operation signal indicating the start of the deformation correction is input from the remote controller light receiving section 10 (step S1). The control section 60 returns to the determination of step S1 in the case where it is determined that the operation signal is not input (step S1 / No).

[0099] The control section 60 determines whether or not an operation signal to change the setting of the number of dots is input in the case where it is determined that the operation signal is input (step S1 / Yes) (step S2). The control section 60 changes the information of the number of dots stored in the storage section 70 to the number of dots indicated by the operation signal in the case where the operation signal to change the setting of the number of dots is input (step S2 / Yes) (step S3).

[0100] The control section 60 calculates the radius r of the dots used in the dot correction in the case where the operation signal to change the setting of the number of dots is not input (step S2 / No) or in the case where the information of the number of dots stored in the storage section 70 is changed in step S3 (step S4). The control section 60 reads out the information of the number of dots and the information of the panel resolution of the panel region 55 from the storage section 70. The control section 60 calculates the radius r of the dots used in the second pattern image 300 on the basis of the read information of the number of dots and the information of the panel resolution by the above-described formula (2).

[0101] Next, the control section 60 generates the second pattern image 300 (step S5). The control section 60 generates the second pattern image 300 in which dots having the radius calculated as the radius r and the number of dots set by the user are arranged in a matrix shape.

[0102] Next, the control section 60 determines the position of the panel region 55 at which the vertex figure 210 included in the first pattern image 200 is drawn (step S6). The control section 60 determines the position of the panel region 55 at which the center of the vertex figure 210 is drawn as the position at which the radius r is spaced inward from each of the upper, lower, left, and right end portions of the panel region 55.

[0103] The control section 60 generates the first pattern image 200 in a manner that the vertex pattern 210 is depicted at the position of the panel region 55 decided (step S7) after deciding the position of the panel region 55 in which the vertex pattern 210 is depicted. The control section 60 causes the generated first pattern image 200 to be displayed on the projection surface 7 by the projection section 50 (step S8).

[0104] Next, the control section 60 determines whether or not an operation of changing the position of the vertex pattern 210 of the first pattern image 200 is accepted based on the operation signal input from the remote control light receiving section 10 (step S9). The control section 60 determines whether or not a determination operation of determining the operation is accepted based on the operation signal input from the remote control light receiving section 10 in a case where the operation of changing the position of the vertex pattern 210 is not accepted (step S9 / No) (step S12). The control section 60 shifts to the processing of step S13 in a case where the determination operation is accepted (step S12 / Yes). In addition, the control section 60 returns to the determination of step S9 in a case where the determination operation is not accepted (step S12 / No).

[0105] In addition, in a case where it is determined that the operation of changing the position of the vertex pattern 210 of the first pattern image 200 is accepted in step S9 (step S9 / Yes), the control section 60 moves the position of the vertex pattern 210 selected by the accepted operation by the selected movement amount. Thus, the position of the vertex pattern 210 is changed (step S10). Then, the control section 60 causes the first pattern image 200 in which the position of the vertex pattern 210 is changed to be displayed on the projection surface 7 by the projection section 50 (step S11). Then, the control section 60 determines whether or not a determination operation of determining the operation is accepted based on the operation signal input from the remote control light receiving section 10 (step S12).

[0106] The control section 60 returns to the determination of step S9 in a case where the determination operation is not accepted (step S12 / No). In addition, the control section 60 generates the first correction data that moves the coordinates of each vertex pattern 210 in the panel region 55 before the deformation to the coordinates of each vertex pattern 210 in the panel region 55 after the deformation in a case where the determination operation is accepted (step S12 / Yes) (step S13). The control section 60 stores the generated first correction data in the storage section 70 (step S13).

[0107] Next, the control section 60 deforms the shape of the second pattern image 300 using the generated first correction data (step S14). In detail, the control section 60 deforms the shape of the second pattern image 300 in a manner that the barycenter or center of the black dot 335 located at the vertex of the second pattern image 300 overlaps each vertex pattern 210 of the first pattern image 200 after the deformation.

[0108] Next, the control section 60 causes the projection section 50 to display the deformed second pattern image 300 on the projection surface 7 (step S15). Then, the control section 60 causes the imaging section 30 to perform imaging (step S16). The imaging section 30 performs imaging as instructed by the control section 60, and outputs the captured image generated by the imaging to the control section 60. The control section 60 temporarily stores the input captured image in the storage section 70. The control section 60 acquires the captured image by reading out from the storage section 70 (step S16).

[0109] Next, the control section 60 detects the detection points 330 by performing image analysis on the acquired captured image (step S17). The control section 60 calculates the determinant of the projection transformation based on the detected detection points 330 (step S18). The control section 60 calculates the determinant of the transformation of the positions of the first point 331, the second point 332, the third point 333, and the fourth point 334 of the second pattern image 300 to the positions of the first point 331, the second point 332, the third point 333, and the fourth point 334 of the captured image.

[0110] Next, the control section 60 performs projection transformation of the positions of the respective points included in the deformed second pattern image 300 using the calculated determinant of the projection transformation, and determines the positions of the respective points captured in the captured image based on the positions of the respective points after the projection transformation (step S19). Next, the control section 60 determines whether or not the correspondence of the points of the second pattern image 300 and the points of the captured image is completed (step S20). The control section 60 returns to the process of step S19 in the case where the correspondence of the points of the second pattern image 300 and the points of the captured image is not completed (step S20 / No).

[0111] In addition, the control section 60 generates second correction data based on the positions of the respective points in the captured image in the case where the correspondence of the points of the second pattern image 300 and the points of the captured image is completed (step S20 / Yes) (step S21). That is, the control section 60 generates second correction data that corrects the positions of the corresponding points of the second pattern image 300 based on the shift of the positions of the points in the captured image.

[0112] Next, the control section 60 performs fast four-corner correction and point correction (step S22). The control section 60 outputs the generated first correction data and second correction data to the image processing section 41. The image processing section 41 corrects the display image data input from the communication I / F 20 in accordance with the first correction data and the second correction data input from the control section 60, and outputs the corrected display image data to the projection section 50. The projection section 50 expands a display image based on the display image data corrected by the first correction data and the second correction data to the panel region 55 of the liquid crystal panel 53. Light emitted from the light source 51 transmits through the panel region 55, thereby generating image light corresponding to the display image data. The generated image light is enlarged by the optical unit 59 and projected onto the projection surface 7.

[0113] 3. Effects of the projection method

[0114] As explained above, the projection method of the present embodiment is a projection method performed by the control section 60 of the projector 1.

[0115] The control section 60 performs processing of projecting the first pattern image 200 onto the projection surface 7, and accepting an operation of changing the positions of the vertices of the first pattern image 200 projected onto the projection surface 7.

[0116] Further, the control section 60 performs processing of deforming the shape of the second pattern image 300 including a plurality of points based on the operation, and projecting the second pattern image 300 onto the projection surface 7.

[0117] Further, the control section 60 performs processing of acquiring a captured image obtained by capturing the projection surface 7 onto which the second pattern image 300 is projected, and generating second correction data that corrects the second pattern image 300 in a manner of correcting the positions of the plurality of points based on the captured image.

[0118] Further, the control section 60 performs processing of projecting an image corrected by the second correction data onto the projection surface 7.

[0119] Therefore, it is possible to correct the deformation of the second pattern image 300 displayed on the projection surface 7, i.e., deformation caused by the projection surface 7 not being directly opposite the projector 1.

[0120] Further, a captured image obtained by capturing the second pattern image 300 including a plurality of points is acquired, and second correction data that corrects the positions of the plurality of points included in the second pattern image 300 is generated based on the acquired captured image.

[0121] Therefore, even if the shape of the projection surface 7 is a complex shape, it is possible to accurately correct the deformation of an image displayed on the projection surface 7.

[0122] The control section 60 also performs processing of changing the position of the vertex of the first pattern image 200 displayed on the projection surface 7 based on the operation.

[0123] The operation-based deformation of the shape of the second pattern image 300 includes changing the shape of the second pattern image 300 in such a manner that the points of the plurality of points disposed at the vertices of the second pattern image 300 are located at the vertices of the changed first pattern image 200.

[0124] Therefore, the shape of the second pattern image 300 displayed on the projection surface 7 can be corrected by the operation of the first pattern image 200 displayed on the projection surface 7.

[0125] The control section 60 performs processing of accepting a setting of the number of points included in the second pattern image 300 and processing of acquiring information of the resolution of the light modulating device 52 possessed by the projector that projects the second pattern image 300 to the projection surface 7. Also, the control section 60 performs processing of deciding the size of the points based on the number of points and the information of the resolution of the light modulating device 52.

[0126] Therefore, the size of the points included in the second pattern image 300 can be decided based on the set number of points and the resolution of the light modulating device 52.

[0127] The projection of the first pattern image 200 to the projection surface 7 includes drawing the first pattern image 200 on the panel region 55 of the light modulating device 52 possessed by the projector 1. Also, it includes generating image light corresponding to the first pattern image 200 by modulating the light incident on the light modulating device 52 by the panel region 55 and projecting the image light to the projection surface 7.

[0128] The control section 60 calculates the number of pixels of the panel region 55 corresponding to the radius of the points based on the resolution of the second pattern image 300 and the number of points constituting the plurality of points included in the second pattern image 300. Also, the control section 60 draws the first pattern image 200 with the pixels of the panel region 55 as the center from the pixels on the outer side to the pixels on the inner side by the number of pixels.

[0129] Therefore, it is possible to prevent the case where the correction accuracy of the deformation of the image displayed on the projection surface 7 decreases due to the fact that a part of the points included in the second pattern image 300 is not displayed on the projection surface 7.

[0130] The first pattern image 200 includes a vertex pattern 210 that indicates the range of the region of the projection surface 7 where the plurality of points can be displayed.

[0131] Therefore, it is possible to indicate the range of the region of the projection surface 7 where the points can be displayed by the vertex pattern 210 and to enable the user to recognize the range of the region of the projection surface 7 where the points can be displayed.

[0132] The first pattern image 200 includes an outer frame 205, which is an image of a frame indicating the range of the area of the projection surface 7 capable of displaying a plurality of points.

[0133] Therefore, the range of the area of the projection surface 7 capable of displaying points can be indicated by the outer frame 205, and the user can recognize the range of the area of the projection surface 7 capable of displaying points.

[0134] 4. Effects of the projector

[0135] As described above, the projector 1 of the present embodiment has a projection section 50 that projects an image to a projection surface 7, a remote controller 5 that functions as a reception section that receives an operation, and a control section 60.

[0136] The control section 60, when an operation to change the position of the vertex of the first pattern image 200 projected to the projection surface 7 is received by the remote controller 5, performs processing of deforming the shape of the second pattern image 300 including a plurality of points based on the operation.

[0137] In addition, the control section 60 performs processing of causing the projection surface 7 to project the second pattern image 300 by the projection section, and acquiring a captured image obtained by capturing the projection surface 7 on which the second pattern image 300 is projected.

[0138] Further, the control section 60 performs processing of generating second correction data that corrects the second pattern image 300 in a manner to correct the positions of the plurality of points based on the captured image, and causing the projection section to project an image corrected by the second correction data to the projection surface 7.

[0139] Therefore, the deformation of the second pattern image 300 displayed on the projection surface 7, that is, the deformation caused by the projection surface 7 not being directly in front of the projector 1, can be corrected.

[0140] In addition, a captured image obtained by capturing the second pattern image 300 including a plurality of points is acquired, and second correction data that corrects the positions of the plurality of points included in the second pattern image 300 is generated based on the acquired captured image.

[0141] Therefore, even if the shape of the projection surface 7 is a complex shape, the deformation of the image displayed on the projection surface 7 can be corrected with high precision.

[0142] The above-described embodiments and each modification example are preferred embodiments of the present application. However, the present application is not limited thereto, and various modifications can be made within the scope of the present application.

[0143] For example, in the above-described embodiment, the detection dots 330 and the black dots 335 included in the dot pattern 310 are respectively represented as the figures included in the second pattern image 300. The shape of the figures is not limited to a dot, and can be, for example, a square, a rectangle, a rhombus, or the like. Further, the configuration in which the second pattern image 300 includes the detection dots 330 and the black dots 335 is exemplified, but is not limited thereto. For example, a pattern image constituted only of the black dots 335 instead of the detection dots 330 can be used as the second pattern image 300. In this case, in correspondence between each of the black dots 335 included in the second pattern image 300 and each of the black dots 335 included in the captured image, it is only necessary to determine in which row and in which column each of the black dots 335 exists in each of the image coordinate systems, and to make the black dots 335 located in the same row and in the same column in each of the images correspond to each other.

[0144] Further, Figure 15 The processing units of the flowchart shown are divided in order to easily understand the processing of the projector 1 according to the main processing contents. The present application is not limited by the division method or the name of the processing units shown in the flowchart. Further, the processing of the projector 1 can be divided into more processing units according to the processing contents, or one processing unit can include more processing. In addition, the processing order of the above-described flowchart is not limited to the example shown. Figure 15

[0145] Further, Figure 1 Each of the functional sections of the projector 1 shown represents a functional configuration realized by cooperation of hardware and software, and the specific installation method is not particularly limited. Therefore, it is not necessarily required to install hardware corresponding to each of the functional sections individually, and it is of course possible to configure so that one processor executes a program to realize the functions of a plurality of functional sections. Further, in the above-described embodiment, a part of the functions realized by software can be realized by hardware, or a part of the functions realized by hardware can be realized by software.

[0146] ​In addition, in a case where the projection method of the present disclosure is implemented using a computer mounted on the projector 1, a program that causes the computer to execute can also be configured in a manner of a recording medium. Furthermore, the program that causes the computer to execute can also be configured in a manner of a transmission medium that transmits the program. The recording medium can use a magnetic, optical recording medium, or a semiconductor storage device. Specifically, a removable or fixed recording medium such as a floppy disk, an HDD (Hard Disk Drive), a CD-ROM (Compact Disc Read-Only Memory), a DVD (Digital Versatile Disc), a Blu-ray Disc, a magneto-optical disk, a flash memory, a card-type recording medium, and the like can be cited. In addition, the above-described recording medium can also be an internal storage device of a server device, that is, a RAM, a ROM, an HDD, or the like, a nonvolatile storage device. Blu-ray is a registered trademark.

[0147] In addition, in the above-described embodiment, the configuration in which the imaging section 30 is built in the projector 1 is shown, but is not limited thereto. As the imaging section 30, a configuration in which a camera separate from the projector 1 is used, or a terminal in which the imaging section 30 is built in can also be used. As the terminal in which the imaging section 30 is built in, for example, a personal computer, a smartphone, a tablet terminal, or the like can be used. In this case, the camera or the terminal in which the imaging section 30 is built in can be configured to perform the processing from step S16 to step S21, and transmit the generated second correction data to the projector.

Claims

1. A projection method, wherein: The projection method contains: Projecting the first image onto a projection surface; accepting an operation of changing the position of a vertex of the first image; Based on the operation, deforming the shape of the second image including the plurality of first graphics; projecting the second image onto the projection surface; acquiring a captured image obtained by capturing the projection surface onto which the second image is projected; generating correction data based on the captured image, the correction data correcting the second image so as to correct positions of the plurality of first patterns; and The image corrected using the correction data is projected onto the projection surface.

2. The projection method according to claim 1, wherein: The projection method further includes: changing the positions of vertices of the first image displayed on the projection surface based on the operation; Deforming the shape of the second image based on the operation includes changing the shape of the second image so that a first figure arranged at a vertex of the second image among the plurality of first figures is located at a vertex of the changed first image.

3. The projection method according to claim 1 or 2, wherein: The projection method also includes: receiving a setting of the number of first graphics constituting the plurality of first graphics included in the second image; obtaining information on a resolution of a light modulator of a projector that projects the second image onto the projection surface; as well as The size of the first pattern is determined based on the number of the first patterns and information on the resolution of the light modulator.

4. The projection method according to claim 1 or 2, wherein: Projecting the first image onto the projection surface includes: drawing the first image in a drawing area of ​​a light modulating device of the projector; modulating light incident on the light modulator through the drawing area to generate image light corresponding to the first image; as well as Projecting the image light onto the projection surface, Calculating the number of pixels of the drawing area corresponding to the radius of the first graphic based on the resolution of the second image and the number of first graphics constituting the plurality of first graphics included in the second image; The first image is drawn around pixels that are the number of pixels inward from the outermost pixel among the pixels in the drawing area.

5. The projection method according to claim 1 or 2, wherein: The first image includes a second graphic indicating a range of an area of ​​the projection surface where the plurality of first graphics can be displayed.

6. The projection method according to claim 1 or 2, wherein: The first image includes a frame image indicating a range of an area of ​​the projection surface where the plurality of first graphics can be displayed.

7. A projector, wherein: The projector includes: a projection lens, which projects an image onto a projection surface; A remote control that accepts operations; and processor, The processor performs the following processing: When an operation for changing the positions of vertices of the first image projected onto the projection surface is accepted via the remote controller, the shape of the second image including the plurality of first figures is deformed based on the operation; projecting the second image onto the projection surface from the projection lens; acquiring a captured image obtained by capturing the projection surface onto which the second image is projected; generating correction data based on the captured image, the correction data correcting the second image so as to correct positions of the plurality of first patterns; and The image corrected using the correction data is projected from the projection lens onto the projection surface.

Images