Portable projector

Abstract

The present invention provides a portable projection device that can easily correct camera shake without pre-setting the projection position, even in situations where camera shake frequently occurs. [Solution] The feature point extraction unit 20 extracts a first feature point from the first captured image and a second feature point from the second captured image. The relative position change amount acquisition unit 21 detects the first and second feature points that correspond to each other based on a comparison of the feature quantities of the first and second feature points, and acquires the amount of change in the relative positional relationship of the first and second captured images from the positional relationship between the corresponding first and second feature points. The projection image control unit 22 controls the projection direction of the projection image, etc., according to the amount of change in the relative positional relationship.

Description

Technical Field

[0001] The present invention relates to a portable projection device.

Background Art

[0002] Patent Document 1 describes a projection-type image display device that projects light rays onto a screen to project and display a projected image, detects displacement of the projected image relative to the screen, and corrects the displacement using an additional optical system provided between the projected image generator and the screen. In Patent Document 1, a screen-side marker group is arranged at the four corners of the screen, and a projected image-side marker group is drawn at the four corners in the projected image. Then, after the screen-side marker group and the projected image-side marker group are photographed and captured as an image, three-element parameters consisting of positional displacement, size displacement, and twist angle between the projected image and the screen are extracted from the image information of the screen-side marker group and the projected image-side marker group. The additional optical system, which has three optical systems formed corresponding to these three-element parameters, moves or deforms the additional optical system based on the extracted three-element parameters to optically correct each displacement. A series of operations from drawing the above marker group to optically correcting the displacement is simultaneously performed as a feedback loop and sequentially performed automatically, thereby gradually aligning the projected image with the screen.

Prior Art Literature

Patent Literature

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] The projection-type image display device described in Patent Document 1 requires a dedicated screen to display the projected image, and is therefore mainly used as a stationary device placed on a table or the like. On the other hand, in recent years, handheld projection devices that are held by hand and project images onto any projection surface such as a wall are being used. In the case of such handheld projection devices, hand shake occurs frequently, so there has been a need to be able to easily correct for hand shake without having to pre-set the projection position on the screen.

[0005] The present invention aims to provide a portable projection device that can easily correct camera shake without pre-setting the projection position, even in situations where camera shake frequently occurs. [Means for solving the problem]

[0006] The portable projection device of the present invention comprises an image projection unit that projects a projection image, an imaging unit that captures at least a portion of the projection surface on which the projection image is projected as an imaging area and acquires a first image and a second image with different imaging timings, and a processor. The processor extracts a first feature point from the first image and a second feature point from the second image, detects corresponding first and second feature points based on a comparison of the feature quantities of the first and second feature points, obtains the amount of change in the relative positional relationship between the first and second image, and controls the projection direction or position of the projection image according to the amount of change in the relative positional relationship.

[0007] Preferably, the imaging area is the area outside the projection image region of the projection plane, with the first feature point extracted from the area outside the projection image region of the first captured image and the second feature point extracted from the area outside the projection image region of the second captured image. Preferably, the imaging area is the projection image overlap region of the projection plane that overlaps with the projection image region, with the first feature point extracted from the projection image overlap region of the first captured image and the second feature point extracted from the projection image overlap region of the second captured image. Preferably, there are multiple first feature points or second feature points. Preferably, there are multiple first feature points and second feature points.

[0008] Preferably, the processor extracts a first feature point and a second feature point each time a first and second image are acquired, and obtains the amount of change in their relative positional relationship. Preferably, the processor restricts the extraction of the first feature point until it becomes impossible to extract the first or second feature point, and uses the extracted first feature point and the second feature point extracted sequentially from the second image to obtain the amount of change in their relative positional relationship.

[0009] Preferably, if at least one of the first or second feature points becomes unextractable, the processor extracts both the first and second feature points and uses the newly extracted first and second feature points to obtain the amount of change in their relative position. Preferably, if the first and second feature points become unextractable, it is because they are outside the imaging area, or because they are included within the area of ​​the projected image, and as a result, the feature quantity of the first or second feature point changes due to the projected image.

[0010] Preferably, the image projection unit has a sensor that detects changes in its position or orientation, and the acquisition of the amount of change in relative positional relationship is performed when the sensor detects a change in position or orientation that exceeds a threshold. The projection surface is provided with position detection markers, and preferably the processor acquires the amount of change in relative positional relationship from the positional relationship between the first feature point, the second feature point, the position detection marker included in the first captured image, and the position detection marker included in the second captured image.

[0011] The processor preferably corrects the projection direction so as to eliminate positional shifts based on changes in relative positional relationships. If the area of ​​the projected image is narrower than the projectable area, the processor preferably corrects the position of the projected image within the projectable area so as to eliminate positional shifts based on changes in relative positional relationships. [Effects of the Invention]

[0012] According to the present invention, even in situations where camera shake frequently occurs, image stabilization can be easily performed without pre-setting the projection position on the screen. [Brief explanation of the drawing]

[0013] [Figure 1] This is a schematic diagram of a portable projection device. [Figure 2] This is a block diagram showing the functions of a portable projector. [Figure 3] (A) is an explanatory diagram showing the imaging area outside the projected image area, and (B) is an explanatory diagram showing the imaging area within the overlapping area of ​​the projected image. [Figure 4] This is an explanatory diagram showing the acquisition timing of the first and second images. [Figure 5] Block diagram showing the functions of a projection control processor device. [Figure 6] This is an explanatory diagram showing the first and second feature points. [Figure 7] This is an explanatory diagram showing the change in the relative positional relationship between each of the first and second feature points. [Figure 8]It is an explanatory diagram illustrating a method for changing a projection direction. [Figure 9] It is an explanatory diagram illustrating a correction method for a position of a projected image. [Figure 10] It is an explanatory diagram illustrating a case where (A) the imaging timings of a first captured image and a second captured image substantially coincide with the acquisition timing of a change amount of a relative positional relationship, and (B) a case where the imaging timings of the first captured image and the second captured image do not coincide with the acquisition timing of the change amount of the relative positional relationship, and the change amount of the relative positional relationship is acquired at a fixed interval. [Figure 11] It is an explanatory diagram illustrating a set of a first captured image P1 and a second captured image P2 formed by a method different from (A)(B), and a set of a first captured image P1 and a second captured image P2 formed by a method different from (B)(A). [Figure 12] It is an explanatory diagram illustrating an acquisition method for a change amount of a relative positional relationship before feature point extraction becomes impossible. [Figure 13] It is an explanatory diagram in which (A) illustrates an acquisition method for a change amount of a relative positional relationship after feature point extraction becomes impossible, the method being different from that of (B), and (B) illustrates an acquisition method for a change amount of a relative positional relationship after feature point extraction becomes impossible, the method being different from that of (A). [Figure 14] It is a block diagram illustrating functions of a portable projection device when a sensor is provided therein. [Figure 15] It is a schematic diagram illustrating a screen and a position detection marker. DETAILED DESCRIPTION OF THE INVENTION

[0014] As shown in FIG. 1, a portable projection device 10 projects a projection image toward a screen SC. Since the portable projection device 10 is provided with a grip GP that is held by a user by hand, the user can freely change the projection direction of the projection image. Accordingly, the portable projection device 10 can project a projection image not only onto a normal projector screen but also onto a wall or the like.

[0015] As shown in FIG. 2, the portable projection apparatus 10 includes an image projection unit 11, an imaging unit 12, and a projection control processor apparatus 13. The image projection unit 11 projects a projection image. The projection image is projected onto a screen SC (see FIG. 1 and FIG. 3). The imaging unit 12 is constituted by a digital camera or the like, and images at least a part of the projection surface (screen SC) onto which the projection image is projected as an imaging region, and acquires a first captured image and a second captured image having different imaging timings.

[0016] Regarding the positional relationship between the imaging region and the projection image region, the positional relationship between the image projection unit 11 and the imaging unit 12 is defined so as to satisfy the following positional relationship. As shown in FIG. 3(A), the imaging region IR is a region PRO outside the projection image region PR outside the projection image region PR in the projection surface (screen SC) onto which the projection image is projected, or as shown in FIG. 3(B), the imaging region IR is preferably a projection image overlapping region PRM overlapping with the projection image region PR in the projection surface. Regarding the overlapping between the imaging region IR and the projection region PR, in addition to a form in which the projection region PR is included in the imaging region IR, there are a form in which the imaging region IR is included in the projection region PR, a form in which the imaging region IR matches the projection region PR, and a form in which the imaging region IR and the projection region PR partially overlap each other.

[0017] Further, as shown in FIG. 4, the imaging unit 12 alternately acquires the first captured image P1 and the second captured image P2 by imaging the imaging region at different imaging timings. One set of the first captured image and the second captured image are transmitted to the projection control processor apparatus 13 and used for controlling the projection image. Note that the positional relationship between the image projection unit 11 and the imaging unit 12 may be fixed or may be changeable. In addition, regarding the imaging timing, there is no problem even if the imaging start timing and imaging end timing deviate as long as imaging is performed at the same instant (the same applies to the acquisition timing). Furthermore, since the imaging timing is assigned for each timing at which the first captured image P1 and the second captured image P2 are respectively obtained, the imaging timing of the first captured image P1 is different from the imaging timing of the second captured image P2.

[0018] As shown in Figure 5, the projection control processor device 13 comprises a feature point extraction unit 20, a relative position change amount acquisition unit 21, and a projection image control unit 22. The portable projection device 10 is provided with a program memory (not shown) for executing various processes. The processor in the portable projection device 10 executes the program in the program memory to realize the functions of the feature point extraction unit 20, the relative position change amount acquisition unit 21, and the projection image control unit 22.

[0019] The feature point extraction unit 20 extracts first feature points from the first captured image P1 and second feature points from the second captured image P2. Specifically, as shown in Figure 6, the feature point extraction unit 20 extracts three first feature points C1a, C1b, and C1c from the first captured image P1 and three second feature points C2a, C2b, and C2c from the second captured image P2. The first and second feature points C1a, C2a, C1b, C2b, C1c, and C2c may be feature points that originally exist on the projection surface, such as scratches or indentations, or they may be feature points that were artificially created when using the projection surface. Here, in order to clearly represent the differences in feature quantities, they are represented by their respective shapes (circle, triangle, square). Furthermore, in order to accurately obtain the amount of change in the relative positional relationship between the first and second captured images, as described later, it is preferable to have multiple first feature points or second feature points, or to have multiple first and second feature points. When extracting multiple feature points, it is preferable that each feature point is spaced apart from the others. For example, feature points may be extracted from a point that straddles the center of the projection area PR, or feature points may be extracted from a point that is set at the edge of the imaging area IR.

[0020] Furthermore, if the imaging area IR is outside the projection image area PRO (see Figure 3(A)), the first feature point is extracted from the PRO outside the projection image area in the first captured image P1, and the second feature point is extracted from the PRO outside the projection image overlap area in the second captured image. This prevents the projection image from acting as noise during the extraction of the first and second feature points. Also, if the imaging area IR is the projection image overlap area PRM (see Figure 3(B)), the first feature point is extracted from the PRM overlapping area in the first captured image P1, and the second feature point is extracted from the PRM overlapping area in the second captured image. This prevents the first and second feature points from becoming unextractable even when the projection plane (screen SC) is finite.

[0021] The relative position change acquisition unit 21 detects corresponding first and second feature points based on a comparison of the feature quantities of the first feature point and the second feature point, and acquires the amount of change in the relative positional relationship between the first and second captured images from the positional relationship between the corresponding first and second feature points. Specifically, as shown in Figure 7, the relative position change acquisition unit 21 compares the feature quantities of the first feature points C1a, C1b, and C1c with the feature quantities of the second feature points C2a, C2b, and C2c, and detects corresponding first and second feature points. In this embodiment, first and second feature points with the same feature quantities are detected as corresponding first and second feature points. Therefore, the second feature point corresponding to the first feature point C1a is the second feature point C2a, which has the same feature quantity as the first feature point C1a, represented by a "circle". Furthermore, the second feature point corresponding to the first feature point C1b is designated as the second feature point C2b, which has the same feature quantity as the first feature point C1b, with a "triangular" shape. Similarly, the second feature point corresponding to the first feature point C1c is designated as the second feature point C2c, which has the same feature quantity as the first feature point C1c, with a "square" shape. Note that for corresponding first and second feature points, this includes cases where the feature quantities of the first and second feature points are completely identical, as well as cases where the difference in feature quantities between the first and second feature points is within an acceptable range, such as error.

[0022] The relative position change amount acquisition unit 21 then calculates the position change amount Da from the positional relationship between the corresponding first feature point C1a and the second feature point C2a. Similarly, it calculates the position change amount Db from the positional relationship between the corresponding first feature point C1b and the second feature point C2b, and calculates the position change amount Dc from the positional relationship between the corresponding first feature point C1c and the second feature point C2c. Based on the position change amounts Da, Db, and Dc, the relative position change amount acquisition unit 21 acquires the change amount D of the relative positional relationship between the first captured image P1 and the second captured image P2. Preferably, the change amount D of the relative positional relationship is a representative value (average value, maximum value, etc.) of the position change amounts Da, Db, and Dc.

[0023] Here, the relative position change D occurs not only when the portable projection device 10 moves in a plane parallel to the projection surface, when it moves in a direction having a component of the normal vector direction N (see Figure 1) of the projection surface, when the angle between the projection direction PD (see Figure 1) of the portable projection device 10 and the normal vector direction N of the projection surface changes, and as a result of a combination of these effects. Therefore, the method for calculating the relative positional relationship change D based on the positional change amounts Da, Db, and Dc differs depending on the cause of the relative position change.

[0024] The projection image control unit 22 controls the projection direction of the image projection unit 11 or the position of the projected image according to the amount of change D in the relative positional relationship. Specifically, as shown in Figure 8, the projection direction of the image projection unit 11 is changed from projection direction PD1 to projection direction PD2 so as to eliminate positional misalignment based on the amount of change D in the relative positional relationship. In this case, trapezoidal correction is performed according to the projection angle (trapezoidal correction based on the angle between projection direction PD1 and projection direction PD2). Alternatively, as shown in Figure 9, if the projection image area PR is narrower than the projectable area PRX, the position of the projected image is corrected within the projectable area PRX so as to eliminate positional misalignment based on the amount of change D in the relative positional relationship. As described above, in this embodiment, feature points on the screen SC that can serve as landmarks for position detection, such as irregularities on a wall, are extracted not only from the first captured image P1 but also from the second captured image P2, which is captured at a different timing than the first captured image P1. By using the amount of positional change of these extracted feature points, it is possible to control the position of the projected image (camera shake correction) without pre-setting markers on the screen SC.

[0025] In the projection control processor device 13, the timing for acquiring the amount of change in relative positional relationship is controlled according to predetermined conditions. Each time a first image P1 and a second image P2 are acquired, the feature point extraction unit 20 extracts the first feature point C1 and the second feature point C2, and the relative position change amount acquisition unit 21 acquires the amount of change D in the relative positional relationship. In this case, each time a first image P1 and a second image P2 are acquired, the first feature point C1 and the second feature point C2 are extracted again.

[0026] Specifically, as shown in Figure 10(A), the change in relative position D is continuously acquired, roughly coinciding with the imaging timing of the imaging unit 12. Alternatively, as shown in Figure 10(B), the change in relative position D may be acquired at regular intervals, without coinciding with the imaging timing of the imaging unit 12. In the case of Figure 10(A), image stabilization can be performed with high accuracy, while in the case of Figure 10(B), image stabilization can be performed with a certain level of accuracy while saving power and improving battery life.

[0027] On the other hand, the feature point extraction unit 20 may restrict (stop) the extraction of the first feature point C1 until at least one of the first feature point C1 or the second feature point C2 becomes unextractable. The relative position change amount acquisition unit 21 uses the first feature point C1 already extracted by the feature point extraction unit 20 and the second feature point C2 sequentially extracted from the second captured image P2 to acquire the relative position change amount D. If at least one of the first feature point C1 or the second feature point C2 becomes unextractable by the feature point extraction unit 20, the first feature point C1 and the second feature point C2 are newly extracted, and the relative position change amount acquisition unit 21 uses the newly extracted first feature point C1 and the second feature point C2 to acquire the relative position change amount D.

[0028] Furthermore, the combination of sets consisting of the first captured image P1 and the second captured image P2 for extracting the first and second feature points C1 and C2 does not have to be unique. For example, as shown in Figure 11(A), sets can be defined in order of imaging timing, such as set S1 of (first captured image P1, second captured image P2), set S2 of (first captured image P1, second captured image P2) at the next imaging timing after set S1, ..., and the first and second feature points C1 and C2 can be extracted for each set S1, S2. Alternatively, as shown in Figure 11(B), when sets are defined for each imaging timing, such as set S1 of (first captured image P1, second captured image P2), set S1a of (second captured image P2 (reusing the second captured image P2 from set S1), first captured image P1) at the next imaging timing after set S1, ..., if the captured image from the previous imaging timing is reused to define the set, the feature points extracted in the previous set can also be reused. In this case, the load of feature point extraction can be reduced.

[0029] For example, as shown in Figure 12, if the first feature point C1 and the second feature point C2 are extracted from the first image P1 and the second image P2 at acquisition timing T1, the first feature point C1 extracted from the first image P1 at acquisition timing T1 will not be updated until it becomes impossible to extract feature points from the first image P1 and the second image P2 at acquisition timing T4. Therefore, at acquisition timings T2 and T3, the first feature point C1 is not extracted from the first image P1, and the second feature point C2 is extracted from the second image P2 alone. This allows for image stabilization with a certain level of accuracy while saving power and improving battery life.

[0030] If at least one of the first or second feature points becomes unextractable, it may be because the first or second feature point is outside the imaging area IR, or because it is included in the projection image area PR, causing the feature quantity of the first or second feature point to change due to the projection image (see Figures 3(A) and (B)). The acquisition timing is assigned to the timing for acquiring the first and second captured images P1 and P2, which are a set of consecutive imaging timings.

[0031] On the other hand, as shown in Figure 13(A), if it becomes impossible to extract the second feature point C2 in the second image P2 acquired at acquisition timing T4, feature point extraction is performed in the first image P1 and the second image P2 acquired at acquisition timing TK (K and L are natural numbers of 5 or greater) after acquisition timing T4 until feature point extraction becomes possible. In this case, it is preferable to move the portable projection device 10 to move the projection area PR to an area where feature points can be easily extracted, or to change to a screen SC that facilitates feature point extraction.

[0032] Furthermore, even if extraction of the second feature point C2 becomes impossible in the second image P2 acquired at acquisition timing T4, it is not necessary to immediately resume extraction of the first feature point C1 and the second feature point C2. In this case, as shown in Figure 13(B), extraction of the first feature point C1 may be temporarily resumed from the first image P1 acquired at acquisition timing T5, and if extraction of the first feature point C1 also becomes impossible, feature point extraction may be performed in the first image P1 and the second image P2 until feature point extraction becomes possible (K and L are natural numbers greater than or equal to 6). Therefore, if extraction of the first feature point C1, which was temporarily resumed, becomes possible, the extraction of the first feature point C1 and the second feature point C2 is not resumed, and the system returns to extracting only the second feature point C2.

[0033] Then, when the first feature point C1 and the second feature point C2 are extracted from the first captured image P1 and the second captured image P2 at acquisition timing TL (L is a natural number greater than or equal to K), the relative position change amount acquisition unit 21 uses the newly extracted first feature point C1 and the second feature point C2 to acquire the amount of change D in the relative positional relationship.

[0034] The timing for acquiring the amount of change in relative position may be controlled using a sensor 30 provided on the image projection unit 11, as shown in Figure 14. This allows for improved battery life through power saving while maintaining a certain level of accuracy in image stabilization. The sensor 30 detects changes in the position or orientation of the image projection unit 11. The relative position change acquisition unit 21 acquires the amount of change D in relative position when the sensor 30 detects a change in position or orientation that exceeds a threshold. Therefore, if the change in position or orientation detected by the sensor 30 is less than the threshold, the already acquired amount of change D in relative position continues to be used, and when the change in position or orientation exceeds the threshold, a new amount of change D in relative position is acquired and updated.

[0035] Furthermore, when acquiring the change in relative positional relationship D, in addition to extracting the first feature point C1 and the second feature point C2 respectively and acquiring the change in relative positional relationship D (see Figures 10(A) and (B)), if the first feature point C1 is extracted, the change in relative positional relationship D may be acquired using the extracted first feature point C1 and the second feature point C2 which is sequentially extracted from the second captured image P2, until at least one of the first feature point C1 or the second feature point C2 becomes unextractable (see Figure 12).

[0036] In the above embodiment, the position of the projected image is controlled using first and second feature points extracted from the first and second captured images, but the position of the projected image may also be controlled by combining other information with the first and second feature points. For example, as shown in Figure 15, position detection markers 40 are provided on the screen SC, which is the projection surface. The position detection markers 40 are provided within the imaging area IR on the screen SC. The relative position change amount acquisition unit 21 then acquires the relative positional change amount D from the first feature points, the second feature points, the position detection markers 40 included in the first captured image, and the position detection markers 40 included in the second captured image. After acquiring the relative positional change amount D, the position of the projected image is controlled in the same manner as in the above embodiment. It is preferable that there are multiple position detection markers 40 (four at the four corners of the screen SC in Figure 15), and that the extraction accuracy of the feature point extraction unit 20 is above a certain level.

[0037] In this case, if the first and second feature points can be extracted, the change in relative position D is obtained from the positional relationship between the first and second feature points, which have the same feature quantities, as well as from the positional relationship between the position detection marker 40 included in the first captured image P and the position detection marker 40 included in the second captured image P2, similar to the embodiment described above. On the other hand, if the first and second feature points become unavailable, the change in relative position D is obtained only from the positional relationship between the position detection marker 40 included in the first captured image P and the position detection marker 40 included in the second captured image P2. Therefore, even if the first and second feature points become unavailable, it is not necessary to change the screen SC, and projection can continue without moving the position of the portable projection device 10, etc.

[0038] In this embodiment, each process is performed on any computer. Furthermore, any computer may perform these processes using a processor, a program, or a combination thereof. Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other hardware element capable of running a program.

[0039] A processor may consist of one or more hardware components, and the type of hardware is not limited. For example, a processor may consist of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a programmable logic device such as an FPGA (Field Programmable Gate Array), a dedicated circuit for executing specific processing such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphic Processing Unit), or an NPU (Neural Processing Unit). Furthermore, the processor has various units or means that execute the various processes described in this embodiment. The type of hardware may also be a combination of different types of hardware. When multiple hardware components are configured to execute one or more processes of a processor, these components may reside in physically separate devices or in the same device. Also, in any embodiment, the order of the processes performed by the processor is not limited to the order described above and may be changed as appropriate. The hardware is composed of electrical circuits (circuitry) combining circuit elements such as semiconductor elements.

[0040] Furthermore, this embodiment may be implemented by hardware, software, firmware, microcode, or a combination thereof. The software, firmware, and microcode are composed of a program. The program may also be, for example, a group of program modules, each of which may be implemented by a processor configured to perform its respective function. The program may be program code or multiple code segments stored on one or more non-temporary computer-readable media (e.g., recording media or other storage). The program may be divided and stored on multiple non-temporary computer-readable media located on devices that are physically separated from each other. The program code or code segment may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. The program code or code segment may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents. [Explanation of Symbols]

[0041] 10. Portable projector 11 Image projection section 12 Photography Department 13 Projection control processor device 20 Feature point extraction unit 21. Relative position change amount acquisition unit 22 Position correction section 30 sensors 40 Position detection markers GP Grip SC Screen PR projection image area PRO Outside projection image area PRM projection image overlap area IR imaging area P1 First captured image P2 Second image C1 First Feature Point C2 Second Feature Point C1a, C1b, C1c: First feature point C2a, C2b, C2c: Second Feature Point Da, Db, Dc position change amount D: Change in relative positional relationship PD1, PD2 projection direction PRX Projection Range

Claims

1. An image projection unit that projects a projected image, A shooting unit captures at least a portion of the projection surface onto which the aforementioned projection image is projected as the shooting area, and acquires a first and second captured image with different shooting timings. Equipped with a processor, The aforementioned processor, A first feature point is extracted from the first captured image, and a second feature point is extracted from the second captured image. Based on a comparison of the feature quantities of the first feature point and the second feature point, the corresponding first and second feature points are detected, and the amount of change in the relative positional relationship between the first and second captured images is obtained from the positional relationship between the corresponding first and second feature points. A portable projection device that controls the projection direction or position of the projected image according to the amount of change in the relative positional relationship.

2. The aforementioned imaging area is outside the projection image area of ​​the projection surface, The portable projection device according to claim 1, wherein the first feature point is extracted from outside the projection image region of the first captured image, and the second feature point is extracted from outside the projection image region of the second captured image.

3. The aforementioned imaging area is a projection image overlapping area of ​​the projection surface that overlaps with the area of ​​the projection image. The portable projection device according to claim 1, wherein the first feature point is extracted from the overlapping region of the projection image in the first captured image, and the second feature point is extracted from the overlapping region of the projection image in the second captured image.

4. The portable projection device according to claim 1, wherein there are multiple first or second feature points.

5. The portable projection device according to claim 1, wherein there are multiple first and second feature points.

6. The portable projection device according to claim 1, wherein the processor extracts the first feature point and the second feature point each time the first image and the second image are acquired, and acquires the amount of change in the relative positional relationship.

7. The aforementioned processor, The portable projection device according to claim 1, which restricts the extraction of the first feature point until the first feature point or the second feature point becomes unextractable, and uses the extracted first feature point and the second feature point sequentially extracted from the second captured image to obtain the amount of change in the relative positional relationship.

8. The aforementioned processor, If at least one of the first or second feature points becomes unextractable, the first and second feature points are newly extracted. The portable projection device according to claim 1, which uses the newly extracted first and second feature points to obtain the amount of change in the relative positional relationship.

9. The portable projection device according to claim 7 or 8, wherein the first feature point and the second feature point become unextractable if they are outside the imaging area or if they are included within the area of ​​the projected image, causing the feature quantity of the first feature point or the feature quantity of the second feature point to change due to the projected image.

10. The image projection unit has a sensor that detects changes in position or orientation, The portable projection device according to claim 1, wherein the acquisition of the amount of change in the relative positional relationship is performed when the sensor detects an amount of change in position or orientation that exceeds a threshold.

11. The projection surface is provided with a position detection marker. The aforementioned processor, The portable projection device according to claim 1, wherein the amount of change in the relative positional relationship is obtained from the positional relationship between the first feature point, the second feature point, the position detection marker included in the first captured image, and the position detection marker included in the second captured image.

12. The portable projection device according to claim 1, wherein the processor corrects the projection direction so as to eliminate positional deviations based on the amount of change in the relative positional relationship.

13. The portable projection device according to claim 1, wherein the processor corrects the position of the projected image within the projectable area so as to eliminate positional shifts based on the change in the relative positional relationship when the area of ​​the projected image is narrower than the projectable area.

Images