Projector and method for projection

Abstract

To allow writing of characters to a target object.SOLUTION: A projector includes: a projection unit for projecting an assisting picture to assist writing, on a target object on which a user is to write; a projection control unit for controlling the range and the shape of projection of the assisting picture projected by the projection unit; an imaging unit for taking an image of a range including the target object; and a shape recognition unit for recognizing the shape of the target object on the basis of the image taken by the imaging unit. The projection control unit controls the range and the shape of projection of the assisting picture on the basis of the result of recognition of the shape recognition unit.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a projection device and a projection method.

Background Art

[0002] When writing characters or the like on an object such as an envelope or a whiteboard, if there is no grid line as a reference, the characters may tilt or undulate in the horizontal or vertical direction, resulting in a poor appearance. In contrast, for example, a technique of projecting a grid line image onto a whiteboard is known (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the configuration described in Patent Document 1, when the object onto which the image is projected is tilted, the grid line is relatively tilted with respect to the object. For this reason, the characters will be written tilted on the object.

[0005] The present invention has been made in view of the above, and an object thereof is to provide a projection device and a projection method that enable writing of characters or the like in accordance with an object.

Means for Solving the Problems

[0006] The projection device according to the present invention includes a projection unit that projects an auxiliary video for assisting entry onto an object entered by a user, a projection control unit that controls the projection range and shape of the auxiliary video projected by the projection unit, an imaging unit that images a range including the object, and a shape recognition unit that recognizes the shape of the object based on an image captured by the imaging unit. The projection control unit controls the projection range and shape of the auxiliary video based on the recognition result of the shape recognition unit.

[0007] The projection method according to the present invention includes an imaging step of imaging a range including an object entered by a user, a shape recognition step of recognizing the shape of the object based on the captured image, a projection control step of controlling the projection range and shape of an auxiliary video for assisting the user's entry, and a projection step of projecting the auxiliary video onto the object. In the projection control step, the projection range and shape of the auxiliary video are controlled based on the recognition result of the shape recognition step.

Advantages of the Invention

[0008] According to the present invention, it is possible to enter characters or the like according to the object.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

MODE FOR CARRYING OUT THE INVENTION

[0010] Hereinafter, embodiments of a projection apparatus and a projection method according to the present invention will be described with reference to the drawings. Note that the present invention is not limited by this embodiment. In addition, the constituent elements in the following embodiments include those that can be replaced by those skilled in the art and are easy to replace, or those that are substantially the same.

[0011] FIG. 1 is a diagram schematically showing an example of a projection device 100 according to the present embodiment. FIG. 2 is a functional block diagram showing an example of the projection device 100. As shown in FIGS. 1 and 2, the projection device 100 includes a projection unit 10, an imaging unit 20, and a control unit 30.

[0012] The projection unit 10 projects an image for assisting in filling onto an object 40 filled in by the user. The projection unit 10 includes a light source (not shown) and a projection optical system (not shown) for projecting an image using the light from the light source. The projection unit 10 can project an image including at least one of, for example, a grid line, characters, and a picture as the image.

[0013] The imaging unit 20 images a range including the object 40 and outputs the captured image to the control unit 30. The imaging unit 20 is composed of an imaging device such as, for example, a visible light camera, a far-infrared camera, or a near-infrared camera. The imaging unit 20 may be composed of, for example, a combination of a visible light camera, a far-infrared camera, and a near-infrared camera.

[0014] The control unit 30 controls the operation of the projection device 100. As shown in FIG. 2, the control unit 30 includes a communication unit 31, a processing unit 32, and a storage unit 33.

[0015] The communication unit 31 performs wired or wireless communication with an external device. The communication unit 31 includes an interface such as a network interface card. In the present embodiment, the projection device 100 can communicate with the terminal device 50 through the communication unit 31.

[0016] Here, the terminal device 50 will be described. The terminal device 50 includes an operation unit 51 and a control unit 52. The operation unit 51 receives various operations from the user for the terminal device 50 and outputs them as operation signals to the control unit. As the operation unit 51, for example, an input device such as a mouse, a keyboard, a touch panel, a button, a lever, a dial, or a switch is used.

[0017] The control unit 52 comprehensively controls the operations of the terminal device 50. The control unit 52 includes a communication unit 53, a processing unit 54, and a storage unit 55. The communication unit 53 performs wired or wireless communication with external devices. The communication unit 53 includes an interface such as a network interface card. In this embodiment, the terminal device 50 can communicate with the projection device 100 via the communication unit 53. The processing unit 54 performs various information processes. The processing unit 54 includes a processor such as a CPU and memories such as a ROM and a RAM. For example, when the setting of the auxiliary video projected on the object 40 is performed by the operation unit 51, the processing unit 54 causes the communication unit 53 to transmit information regarding the setting of the auxiliary video (hereinafter referred to as setting information) to the projection device 100. The storage unit 55 stores information such as various programs and data. The storage unit 55 includes a storage such as an HDD and an SSD.

[0018] As described above, the terminal device 50 can be used as an operation unit of the projection device 100. Note that an operation unit having the same functions as the terminal device 50 may be provided in the projection device 100. In this case, the setting of the auxiliary video can be performed by operating the operation unit provided in the projection device 100.

[0019] The processing unit 32 performs various information processes. The processing unit 32 includes a processor such as a CPU (Central Processing Unit) and memories such as a ROM (Read Only Memory) and a RAM (Random Access Memory).

[0020] The processing unit 32 includes a projection control unit 35 and a shape recognition unit 36.

[0021] The projection control unit 35 controls the position and shape of the video projected by the projection unit 10. The projection control unit 35 acquires various information such as information regarding the auxiliary video transmitted from the terminal device 50 via the communication unit 31. Further, the projection control unit 35 acquires the recognition result of the shape recognition unit 36. The projection control unit 35 controls the position and shape of the video based on the acquired information regarding the auxiliary video and the recognition result of the shape recognition unit 36.

[0022] Based on the image captured by the imaging unit 20, the shape recognition unit 36 recognizes the shape of the object 40. The shape recognition unit 36 acquires the image captured by the imaging unit 20. When a straight line portion 45 (see FIG. 3) is provided on the object 40, the shape recognition unit 36 can recognize the straight line portion 45. When an index Q (see FIG. 16) indicating a rectangular shape is provided on the object 40, the shape recognition unit 36 can recognize the index Q.

[0023] The storage unit 33 stores information such as various programs and data. The storage unit 33 includes a storage such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive).

[0024] The storage unit 33 includes, for example, a projection process for projecting an image that assists in filling in the object 40 filled in by the user, a projection control process for controlling the position and shape of the projected image, an acquisition process for acquiring an image obtained by imaging the range including the object 40, and a shape recognition process for recognizing the shape of the object 40 based on the acquired image. In the projection control process, a projection program for controlling the position and shape of the image based on the recognition result of the shape recognition process is stored.

[0025] In the control unit 30, the processor reads out various programs in the processing unit 32 and expands them in the memory, thereby executing information processing corresponding to the functions of the above-mentioned units. Examples of the various programs include programs stored in the storage unit 33, programs recorded on an external recording medium, and the like. The control unit 30 functions as an information processing device (computer) that executes various information processes. Note that another information processing device different from the control unit 30 may execute various programs, or the control unit 30 and another information processing device may cooperate to execute various programs.

[0026] Next, a projection method using the projection apparatus 100 configured as described above will be described. FIG. 3 is a diagram showing an example of the positional relationship between the object 40 and the projection apparatus 100. FIG. 3 shows a state in which the object 40 and the projection apparatus 100 are viewed from above. As shown in FIG. 3, first, the object 40 filled in by the user and the projection apparatus 100 are arranged, for example, on the same work surface D. The work surface D is, for example, the upper surface of a desk or the like and is planar. As the object 40, for example, a rectangular piece of paper will be described as an example. At this time, the object 40 and the projection apparatus 100 are arranged such that the object 40 is within the range that can be photographed by the imaging unit 20 and is at a position where an auxiliary image can be projected onto the object 40 by the projection unit 10. Further, the object 40 may be arranged inclined with respect to the front direction of the projection apparatus 100, that is, the direction along the optical axes of the projection unit 10 and the imaging unit 20. Also, the user sets the type of auxiliary image to be projected onto the object 40 using the terminal device 50. The type of auxiliary image includes, for example, at least one of ruled lines, characters, and pictures. For example, when "ruled lines" are set as the auxiliary image, the number of ruled lines, the interval between the ruled lines, etc. can be set.

[0027] The imaging unit 20 photographs the object 40 and outputs the photographed image to the control unit 30. In the control unit 30, the shape recognition unit 36 recognizes the shape of the object 40 based on the image from the imaging unit 20. FIG. 4 is a diagram showing an example of the image I1 photographed by the imaging unit 20. As shown in FIG. 4, for example, when the shape recognition unit 36 detects the largest trapezoid 60 in the image I1, the trapezoid 60 can be regarded as the image of the object 40. At this time, the shape recognition unit 36 detects the lower base 61, the upper base 62, the left side 63, and the right side 64 of the trapezoid 60 as straight line portions 65.

[0028] FIGS. 5 to 7 are diagrams schematically showing an example of the processing in the shape recognition unit 36. As shown in FIG. 5, the shape recognition unit 36 obtains a point (hereinafter referred to as the vanishing point 66) that intersects when the left and right sides (left side 63, right side 64) of the detected trapezoid 60 are extended based on the image I1, and obtains the position of the vanishing point 66 in the image I1.

[0029] As shown in FIG. 6, the shape recognition unit 36 connects two points 61a and 61b, each having a predetermined length A1 (see FIG. 3 etc.), from the left and right ends of the lower base 61 of the trapezoid 60 to the vanishing point 66 with straight lines 71 and 72, respectively, in the image I1. Further, the shape recognition unit 36 connects the midpoint 61c of the lower base 61 of the trapezoid to the vanishing point 66 with a straight line 73 in the image I1.

[0030] In this embodiment, the projection device 100 and the object 40 are arranged and used on the working surface D, which is the same plane. In this case, the height from the working surface D to the imaging unit 20 and the imaging direction of the imaging unit 20 with respect to the working surface D do not change. Therefore, the correspondence relationship between the distance on the image I1 between any two points in the image I1 captured by the imaging unit 20 and the distance in the actual object 40 can be easily calculated. That is, the actual distance corresponding to one pixel of the pixels in the image I1 is longer in the lower part of the figure in the image I1 and shorter in the upper part of the figure.

[0031] Utilizing this principle, the shape recognition unit 36 can obtain the correspondence relationship between the lower base 61, upper base 62, left side 63, and right side 64 of the trapezoid 60 and the upper side 41, lower side 42, right side 43, and left side 44 of the object 40. In the example of this embodiment, the lower base 61 of the trapezoid 60 corresponds to the upper side 41 of the object 40, the upper base 62 of the trapezoid 60 corresponds to the lower side 42 of the object 40, the left side 63 of the trapezoid 60 corresponds to the right side 43 of the object 40, and the right side 64 of the trapezoid 60 corresponds to the left side 44 of the object 40. At this time, the shape recognition unit 36 recognizes the upper side 41, lower side 42, right side 43, and left side 44 of the object 40 corresponding to the respective sides detected as the straight line part 65 in the trapezoid 60 as the straight line part 45, respectively.

[0032] Further, as shown in FIG. 7, the shape recognition unit 36 obtains a point 67 on the image I1 that has a predetermined length A2 (see FIG. 3 etc.) downward from the upper side 41 of the object 40 and a point 68 on the image I1 that has a predetermined length A3 upward from the lower side 42 of the object 40 with reference to the obtained straight line 73.

[0033] Based on the above processing results in the shape recognition unit 36, the projection control unit 35 sets the projection range and shape of the auxiliary video. FIGS. 8 and 9 are diagrams schematically showing an example of the processing by the projection control unit 35. The projection control unit 35, for example, as shown in FIG. 8, sets the area within the object 40 corresponding to the area 76 surrounded by the straight lines 71 and 72 obtained in the image I2, the straight line 74 passing through the point 67 and parallel to the lower base 61, and the straight line 75 passing through the point 68 and parallel to the upper base 62 as the projection range R1 (see FIG. 10) of the auxiliary video.

[0034] The projection control unit 35 sets the shape of the auxiliary video so as to fit within the set projection range R. The projection control unit 35 can apply, for example, the type of the auxiliary video set by the user using the terminal device 50. For example, as shown in FIG. 9, when a grid line is set as the auxiliary video, the projection control unit 35 can set the shape (for example, the direction in which the straight line extends, etc.) of the auxiliary video M1 so as to be perpendicular or parallel to the straight line portion 45 of the object 40. The auxiliary video M1 shown in FIG. 9 is, for example, a video including a plurality of grid lines L1. In the auxiliary video M1, the projection control unit 35 can set a plurality of grid lines L1 so as to be parallel to the upper side 41 and the lower side 42 which are the straight line portions 45. Regarding the interval d1 (see FIG. 10) in the vertical direction (the direction perpendicular to the upper side 41 and the lower side 42, or the direction parallel to the right side 43 and the left side 44) of the plurality of grid lines L1, for example, the content set by the user using the terminal device 50 can be applied. By setting the shape of the auxiliary video M1 in this way, even when the object 40 is arranged inclined with respect to the front direction of the projection device 100, the shape of the auxiliary video M1 is set so as to correspond to the direction according to the inclination of the object 40.

[0035] Based on the setting result of the auxiliary video M1, the projection control unit 35 causes the projection unit 10 to project the auxiliary video M1 onto the object 40. By this process, as shown in FIG. 10, the auxiliary video M1 is projected onto the object 40. FIG. 10 is a diagram showing an example of a state where the auxiliary video M1 is projected onto the object 40. FIG. 10 shows the object 40 and the projection device 100 as viewed from above. As shown in FIG. 10, while the object 40 is arranged inclined with respect to the front direction of the projection device 100, the auxiliary video M1 is projected so that the ruled line L1 extends in a direction corresponding to the inclination of the object 40. The user can suppress the characters from tilting or undulating with respect to a predetermined direction by writing characters or the like along the ruled line L1 of the auxiliary video M1 projected on the object 40. For this reason, it becomes possible to write characters or the like according to the object.

[0036] FIG. 11 is a diagram showing another example of the object. FIG. 11 shows the object 140 and the projection device 100 as viewed from above. In the example shown in FIG. 11, the object 140 is provided with a rectangular entry field S. The entry field S is printed on the object 140, for example. Similarly, when writing characters or the like on such an object 140, the object 140 and the projection device 100 are arranged, for example, on the same work surface D. Further, the object 140 and the projection device 100 are arranged so that the object 140 exists within the range that can be photographed by the imaging unit 20 and the auxiliary video can be projected onto the object 140 by the projection unit 10. The user sets the type of the auxiliary video to be projected onto the object 40 by the terminal device 50. Hereinafter, the case where a "ruled line" is set as the auxiliary video as described above will be described as an example.

[0037] The imaging unit 20 captures the object 140 and outputs the captured image to the control unit 30. In the control unit 30, the shape recognition unit 36 recognizes the shape of the object 140 based on the image from the imaging unit 20. FIG. 12 is a diagram showing an example of the image I2 captured by the imaging unit 20. As shown in FIG. 12, for example, when the shape recognition unit 36 detects the largest trapezoid 160 in the image I2, the trapezoid 160 can be regarded as the image of the object 140. In this case, the shape recognition unit 36 can detect that the object 140 has a rectangular shape by associating each side of the trapezoid 160 with each side of the object 140. Further, when the shape recognition unit 36 detects a trapezoid 170 different from the trapezoid 160 inside the trapezoid 160, the trapezoid 170 can be regarded as the image of the entry field S. At this time, the shape recognition unit 36 detects the lower base 171, upper base 172, left side 173, and right side 174 of the trapezoid 170 as the straight line part 175.

[0038] The shape recognition unit 36 obtains the correspondence between the lower base 171, upper base 172, left side 173, right side 174 of the trapezoid 170 and the upper side S1, lower side S2, right side S3, left side S4 (see FIG. 11) of the entry field S of the object 140. In the example of the present embodiment, the lower base 171 of the trapezoid 170 corresponds to the upper side S1 of the entry field S, the upper base 172 of the trapezoid 170 corresponds to the lower side S2 of the entry field S, the left side 173 of the trapezoid 170 corresponds to the right side S3 of the entry field S, and the right side 174 of the trapezoid 170 corresponds to the left side S4 of the entry field S. At this time, the shape recognition unit 36 recognizes the upper side S1, lower side S2, right side S3, left side S4 of the entry field S corresponding to each side detected as the straight line part 175 in the trapezoid 170 as the straight line part S5 (see FIG. 11), respectively.

[0039] The projection control unit 35 sets the projection range and shape of the auxiliary video based on the above processing result in the shape recognition unit 36. For example, when the projection control unit 35 detects the trapezoid 170 regarded as the image of the entry field S as described above, the projection control unit 35 can set the area 176 surrounded by the trapezoid 170 as the projection range R2 (see FIG. 13) of the auxiliary video.

[0040] The projection control unit 35 sets the shape of the auxiliary image so as to fit within the set projection range R2. For example, when a grid line is set as the auxiliary image, the projection control unit 35 can set the shape (e.g., the direction in which the line extends, etc.) of the auxiliary image M2 to be perpendicular or parallel to the straight line portion S5 of the entry field S. The auxiliary image M2 shown in FIG. 12 is, for example, an image including a plurality of grid lines L2. In the auxiliary image M2, the projection control unit 35 can set a plurality of grid lines L2 to be parallel to the upper side S1 and the lower side S2 which are the straight line portion S5. Regarding the interval d2 in the vertical direction (the direction perpendicular to the upper side S1 and the lower side S2, in other words, the direction parallel to the right side S3 and the left side S4) of the plurality of grid lines L2, for example, the content set by the user using the terminal device 50 can be applied.

[0041] Based on the setting result of the auxiliary image M, the projection control unit 35 causes the projection unit 10 to project the auxiliary image onto the entry field S of the object 140. By this process, as shown in FIG. 13, the auxiliary image M2 is projected onto the entry field S of the object 140. FIG. 13 is a diagram showing an example of a state in which the auxiliary image M2 is projected onto the object 140. FIG. 13 shows the object 140 and the projection device 100 as viewed from above. The user can suppress the situation where the characters are tilted or wavy with respect to a predetermined direction by writing along the grid lines L2 of the auxiliary image M2 projected on the object 140. For this reason, it becomes possible to write characters and the like in accordance with the entry field.

[0042] In the above description, the case where the projection control unit 35 projects an image including the grid lines L2 as the auxiliary image M2 has been described as an example, but it is not limited to this image. The projection control unit 35 may project other types of images as the auxiliary image M2.

[0043] Figs. 14 and 15 are diagrams showing other examples of the state in which the auxiliary video is projected onto the object. Figs. 14 and 15 show the object 140 and the projection device 100 as viewed from above. As shown in Fig. 14, instead of the ruled line L2, an auxiliary video M3 including a frame F may be projected. When the characters to be entered in the entry field S are predetermined, the user can register the characters to be entered using the terminal device 50. In this case, the projection control unit 35 can set the arrangement and size of the frame F according to the type of the characters to be entered. For example, when entering a postal code and an address in the entry field S as shown in Fig. 14, the projection control unit 35 can set the arrangement and size of the frame F to be different according to the type of the characters to be entered, such as a frame F1 for entering the postal code, a frame F2 for entering Chinese characters of the address, and a frame F3 for entering numbers such as the house number. Further, as shown in Fig. 15, the projection control unit 35 may project an auxiliary video M4 including a character string G in the entry field S instead of the ruled line L2 and the frame F. In this case, since the user only needs to enter along the character string G included in the projected auxiliary video M4, the burden on the user's entry work can be reduced. Also, typos during entry can be prevented.

[0044] Also, in the above description, when the shape recognition unit 36 detects the largest trapezoid 160 in the image I2, the configuration of regarding the trapezoid 160 as the image of the object 140 and detecting that the object 140 has a rectangular shape by associating each side of the trapezoid 160 with each side of the object 140 has been described as an example, but the present invention is not limited to this configuration. For example, the shape recognition unit 36 may not detect the trapezoid 160. In this case, when the shape recognition unit 36 detects a trapezoid 170 in the image I2 and detects that the entry field S corresponding to the trapezoid 170 has a rectangular shape, the shape of the entry field S may be recognized as the shape of the object 140.

[0045] Further, instead of the trapezoid 170 corresponding to the entry field S, the shape recognition unit 36 may detect an index provided on the object and recognize the shape of the object based on the index. FIG. 16 is a diagram showing an example of the object. FIG. 16 shows a state in which the object 240 and the projection device 100 are viewed from above. In the example shown in FIG. 16, instead of the rectangular entry field S, an index Q having a predetermined shape is provided on the object 240. In the example shown in FIG. 16, the index Q has a double bracket shape, but the shape of the index Q is not limited to this example and may be any shape. The index Q indicates a rectangular shape, for example, by being arranged at positions corresponding to the four corners of the rectangular shape. Note that the index may be arranged at positions corresponding to the four sides of the rectangular shape. It is sufficient that the rectangular shape serving as the reference for entry can be specified by the index Q. The index Q may be arranged, for example, in a state printed on the object 240, or may be configured as a separate member from the object 240. Instead of recognizing the rectangular shape formed by the upper side 241, the lower side 242, the right side 243, and the left side 244 of the object 240, the shape recognition unit 36 may recognize the rectangular shape based on the index Q.

[0046] FIG. 17 is a diagram showing an example of the image I3 captured by the imaging unit 20. As shown in FIG. 17, when the shape recognition unit 36 detects four index portions Qa corresponding to the index Q, the shape recognition unit 36 sets a region of a trapezoid 270 having the four index portions Qa as corners, respectively, and can detect the lower base 271, the upper base 272, the left side 273, and the right side 274 of the trapezoid 270 as straight portions 275. In this case, the shape recognition unit 36 can recognize the rectangular shape indicated by the index Q as the shape of the object 240 by detecting the trapezoid 270 and detecting that the index Q corresponding to the trapezoid 270 indicates a rectangular shape.

[0047] FIG. 18 is a flowchart showing an example of the projection method according to the present embodiment. As shown in FIG. 18, the projection method according to the present embodiment includes an imaging step S10, a shape recognition step S20, a projection control step S30, and a projection step S40.

[0048] In imaging step S10, the imaging unit 20 images a range including the object filled in by the user. The imaging unit 20 outputs the captured image to the control unit 30. In the control unit 30, the shape recognition unit 36 acquires the image from the imaging unit 20.

[0049] In shape recognition step S20, the shape recognition unit 36 recognizes the shape of the object based on the image acquired from the imaging unit 20.

[0050] In projection control step S30, the projection control unit 35 controls the projection range and shape of the auxiliary video that assists the user's filling based on the recognition result of the shape recognition unit. In projection control step S30, the projection control unit 35 controls the projection range and shape of the auxiliary video based on the recognition result in shape recognition step S20.

[0051] As described above, the projection device 100 according to the present embodiment includes a projection unit 10 that projects auxiliary videos (M1, M2, M3, M4, M5) that assist filling for the objects (40, 140, 240, 340, 440) filled in by the user, a projection control unit 35 that controls the projection range (R1, R2, R3, R4, R5) and shape of the auxiliary video projected by the projection unit 10, an imaging unit 20 that images a range including the object, and a shape recognition unit 36 that recognizes the shape of the object based on the images (I1, I2, I3, I4, I5) captured by the imaging unit 20. The projection control unit 35 controls the projection range and shape of the auxiliary video based on the recognition result of the shape recognition unit 36.

[0052] Further, the projection method according to the present embodiment includes a projection step of projecting an auxiliary video that assists filling for the object filled in by the user, a projection control step of controlling the projection range and shape of the projected auxiliary video, an imaging step of imaging a range including the object, and a shape recognition step of recognizing the shape of the object based on the captured image. In the projection control step, the projection range and shape of the auxiliary video are controlled based on the recognition result of the shape recognition step.

[0053] According to this configuration, since the projection range and shape of the auxiliary video to be projected are controlled based on the recognition result in the shape recognition unit 36, when the object itself on which the auxiliary video is projected is tilted, etc., the projection range and shape of the auxiliary video are controlled according to the tilt of the object. Thereby, it is possible to suppress the auxiliary video from tilting relative to the object, so that it becomes possible to write characters or the like according to the object.

[0054] In the projection device 100 according to the present embodiment, the shape recognition unit 36 detects trapezoids 60, 160, 170, 270 from the image captured by the imaging unit 20, and the projection control unit 35 controls the projection range and shape of the auxiliary video based on the trapezoids 60, 160, 170, 270 detected by the shape recognition unit 36. According to this configuration, by extracting a rectangular shape based on the trapezoids 60, 160, 170, 270, the shape of an object or the like can be appropriately recognized. Thereby, the projection range and shape of the auxiliary video can be appropriately controlled.

[0055] In the projection device 100 according to the present embodiment, the object has a straight portion, the shape recognition unit 36 recognizes the straight portion of the object, and the projection control unit 35 projects the auxiliary video onto the projection unit 10 along a direction perpendicular or parallel to the straight portion of the object based on the recognition result of the shape recognition unit 36. According to this configuration, since the auxiliary video is projected along a direction perpendicular or parallel to the straight portion of the object, by writing along the auxiliary video, it is possible to appropriately write in the direction corresponding to the straight portion.

[0056] In the projection device 100 according to the present embodiment, the object has an index Q indicating a rectangular shape, the shape recognition unit 36 recognizes the index Q of the object, and the projection control unit 35 projects the auxiliary video onto the projection unit 10 along a direction perpendicular or parallel to one side of the rectangular shape of the object based on the recognition result of the shape recognition unit 36. According to this configuration, since the auxiliary video is projected along a direction perpendicular or parallel to one side of the rectangular shape of the object, by writing along the auxiliary video, it is possible to appropriately write in the direction corresponding to one side of the rectangular shape.

[0057] FIG. 19 is a diagram showing another example of the object. FIG. 19 shows the object and the projection device 100 as viewed from above. In the example shown in FIG. 19, the object 340 is a piece of clothing such as a T-shirt. The object 340 has a shape that is symmetric about the central axis AX. Thus, the object is not limited to paper and may be formed of other materials such as cloth. Also, the object is not limited to a rectangular shape as long as it has a shape that is symmetric about the central axis AX.

[0058] When the object 340 is clothing, the imaging unit 20 captures an image of the object 340 as described above and outputs the captured image to the control unit 30. In the control unit 30, the shape recognition unit 36 recognizes the shape of the object 340 based on the image from the imaging unit 20. For example, the shape recognition unit 36 obtains the central axis AX of the object 340 by image processing or the like.

[0059] The projection control unit 35 sets the projection range and shape of the auxiliary video based on the above processing result in the shape recognition unit 36. The projection control unit 35 can, for example, in the object 340, set, as the projection range R4 of the auxiliary video, a region extending in a direction perpendicular to the central axis AX with the central axis AX as the center. Note that the projection control unit 35 can appropriately adjust the position of the projection range R4 in the direction along the central axis AX, such as, for example, at the central position, at a position above the center, or at a position below the center, in the direction along the central axis AX in the object 340. The shape of the projection range R4 is not limited to a rectangular shape and may be other polygonal shapes such as a triangle or a pentagon, or may be a shape such as a circle, an ellipse, or an oblong, or a shape obtained by appropriately combining these shapes. The projection control unit 35 can set the shape of the auxiliary video M4 so as to fit within the set projection range R4. After setting the shape of the auxiliary video M4, the projection control unit 35 can project the auxiliary video M4 from the projection unit 10 onto the object 340 as shown in FIG. 19. In FIG. 19, an example is given where the auxiliary video M4 includes an image of a rectangular frame, but it is not limited to this, and it may include other types of videos such as grid lines or characters.

[0060] FIG. 20 is a diagram showing another example of an object. FIG. 20 shows a state of the object and the projection device 100 as viewed from above. In the example shown in FIG. 20, the object 440 is, for example, circular. When the object 440 is circular, the imaging unit 20 captures an image of the object 440 as described above and outputs the captured image to the control unit 30. In the control unit 30, the shape recognition unit 36 recognizes the shape of the object 440 based on the image from the imaging unit 20. For example, the shape recognition 36 obtains the center point P of the circular object 440 by image processing or the like.

[0061] Based on the above processing result in the shape recognition unit 36, the projection control unit 35 sets the projection range and shape of the auxiliary video. The projection control unit 35 can, for example, set, in the object 440, a region extending in the radial direction with the center point P as the center as the projection range R5 of the auxiliary video. The shape of the projection range R5 is not limited to a rectangular shape, and may be other polygonal shapes such as a triangle or a pentagon, or may be a shape such as a circle, an ellipse, or an oblong, or a shape obtained by appropriately combining these shapes. The projection control unit 35 can set the shape of the auxiliary video M5 so as to fit within the set projection range R5. After setting the shape of the auxiliary video M5, the projection control unit 35 can project the auxiliary video M5 from the projection unit 10 onto the object 440 as shown in FIG. 20. In FIG. 20, the case where the auxiliary video M5 includes an image of a rectangular frame is taken as an example, but it is not limited to this, and it may include other types of videos such as grid lines or characters.

[0062] The technical scope of the present invention is not limited to the above embodiments, and appropriate changes can be made without departing from the spirit of the present invention. For example, in the above embodiments, the configuration in which the projection device 100 projects an auxiliary video onto an object arranged on the work surface D has been described as an example, but it is not limited to this configuration. The projection device 100 may project an auxiliary video, for example, using a whiteboard, a wall, a floor, etc. as the object.

Explanation of Reference Numerals

[0063] AX... central axis, D... working surface, F, F1, F2, F3... frame, G... character string, I1, I2, I3... image, L1, L2... grid line, M, M1, M2, M3, M4, M5... auxiliary video, P... center point, Q... indicator, Qa... indicator part, R, R1, R2, R4, R5... projection range, S... entry field, S1, 41, 241... upper side, S2, 42, 242... lower side, S3, 43, 64, 174, 243, 274... right side, S4, 44, 63, 173, 244, 273... left side, S5, 45, 65, 175, 275... straight line part, 10... projection part, 20... imaging part, 30, 52... control part, 31, 53... communication part, 32, 54... processing part, 33, 55... memory part, 34... information acquisition part, 35... projection control part, 36... shape recognition part, shape recognition, 40, 140, 240, 340, 440... object, 50... terminal device, 51... operation part, 60, 160, 170, 270... trapezoid, 61, 171, 271... lower base, 61a, 61b... point, 61c... midpoint, 62, 172, 272... upper base, 66... vanishing point, 71, 72, 73, 74, 75... straight line, 76, 176... area, 100... projection device

Claims

1. A projection unit that projects an auxiliary video for assisting in filling in for an object filled in by a user, A projection control unit that controls the projection range and shape of the auxiliary video projected by the projection unit, An imaging unit that images a range including the object, A shape recognition unit that recognizes the shape of the object based on an image captured by the imaging unit and the projection control unit controls the projection range and shape of the auxiliary video based on the recognition result of the shape recognition unit Projection device.

2. The object has a straight line portion, the shape recognition unit recognizes the straight line portion of the object, and the projection control unit projects the auxiliary video onto the projection unit along a direction perpendicular or parallel to the straight line portion of the object based on the recognition result of the shape recognition unit The projection device according to claim 1.

3. The shape recognition unit detects a trapezoidal shape from an image captured by the imaging unit, and the projection control unit controls the projection range and shape of the auxiliary video based on the trapezoidal shape detected by the shape recognition unit The projection device according to claim 1 or claim 2.

4. The object has an indicator indicating a rectangular shape, the shape recognition unit recognizes the indicator of the object, and the projection control unit projects the auxiliary video onto the projection unit along a direction perpendicular or parallel to one side of the rectangular shape of the object based on the recognition result of the shape recognition unit The projection device according to claim 1.

5. An imaging step of imaging a range including an object filled in by a user, A shape recognition step of recognizing the shape of the object based on the captured image, A projection control step of controlling the projection range and shape of an auxiliary video for assisting in the user's filling in, and a projection step of projecting the auxiliary video onto the object including, in the projection control step, the projection range and shape of the auxiliary video are controlled based on the recognition result of the shape recognition step Projection method.

Images