Image projection method, image projection device, unmanned aerial vehicle, and image projection program.

Abstract

To enable users to view image information even without carrying a display device such as a mobile terminal, or without a display device such as a screen or display in their vicinity. [Solution] The system identifies the location of any part of the user's body and uses that location as a screen to project images transmitted or delivered to the user 201 using a projector mounted on a drone ("drone projector"). An "art top screen" 400 is realized on the palm of at least one of the user's right and left hands. The body part may be the palm as shown in Figures 1 to 3 ("palm top screen"), the wrist as shown in Figure 5 ("wrist top screen"), or other parts such as the knee, leg, or foot ("laptop screen", "leg top screen", "foot top screen", "sole top screen"). The user does not need a display or dedicated screen to view the images.

Description

Technical Field

[0001] This invention relates to an image projection method for projecting an image, an image projection device for realizing the image projection method, a drone, and an image projection program.

Background Art

[0002] In recent years, the diversity of opportunities to view images on information terminal devices such as smartphones has been increasing. As a related technology, conventionally, specifically, for example, a projection unit is mounted on a robot capable of autonomous driving, and while detecting the state of a projection surface existing around the robot, an image is projected onto the projection surface so that an image visible to unspecified people can be displayed. There has been a technology related to a video display system (see, for example, Patent Document 1 below).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Patent Document 7

Patent Document 8

Patent Document 9

Patent Document 10

[0004] However, without display devices such as information terminals, or where display devices such as screens were not installed, image information could not be viewed. Furthermore, projectors could only project images onto predetermined screens.

[0005] Furthermore, the conventional technology described in Patent Document 1 mentioned above had the problem of not being suitable for viewing image information addressed to an individual.

[0006] This invention aims to solve the problems of the prior art described above by providing an image projection method that allows users to view image information even without carrying a display device such as a mobile terminal, or without any display devices such as displays or screens in the vicinity; an image projection device that implements this image projection method; an unmanned aerial vehicle; and an image projection program. [Means for solving the problem]

[0007] To solve the above-mentioned problems and achieve the objective, the image projection method according to this invention is characterized by identifying the location of a user and any part of the user's body, and projecting an image transmitted or delivered to the user onto the identified part, which is used as a screen.

[0008] Further, the image projection method according to this invention is characterized in that, in the above invention, an image projection device for projecting the image is moved to a position where the image can be projected onto the arbitrary part.

[0009] Further, the image projection method according to this invention is characterized in that, in the above invention, the image projection device is moved using a drone.

[0010] Further, the image projection method according to this invention is characterized in that, in the above invention, the image projection device is moved using indoor equipment.

[0011] Further, the image projection method according to this invention is characterized in that, in the above invention, the indoor equipment is at least one of the indoor wall surface, ceiling, and floor, and the image projection device is moved along the indoor equipment.

[0012] [[ID=十七]] Further, the image projection method according to this invention is characterized in that, in the above invention, the arbitrary part of the user serving as the screen is set by the designation of the user.

[0013] Further, the image projection method according to this invention is characterized in that, in the above invention, the arbitrary part of the user serving as the screen is selected based on the content of the image.

[0014] Further, the image projection method according to this invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the state of the arbitrary part of the user serving as the screen.

[0015] Further, the image projection method according to this invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the situation around the arbitrary part of the user serving as the screen.

[0016] It should be noted that there seems to be an incorrect tag "十七" in the original text which has been left as is in the translation for the purpose of following the rules. If this is an error in the original, it may need to be corrected for a more accurate translation.Also, in the image projection method according to this invention, in the above invention, the situation around the arbitrary part is the brightness of the surroundings, which is a feature.

[0017] Also, in the image projection method according to this invention, in the above invention, it is characterized by recognizing the image projected on the screen and changing the projection method based on the situation of the recognized image.

[0018] Also, in the image projection method according to this invention, in the above invention, the arbitrary part of the user that serves as the screen is a part of the user's body that the user can visually recognize.

[0019] Also, in the image projection method according to this invention, in the above invention, the arbitrary part of the user that serves as the screen is the user's hand or arm, which is a feature.

[0020] Also, in the image projection method according to this invention, in the above invention, the arbitrary part of the user that serves as the screen is the user's leg or foot, which is a feature.

[0021] Also, in the image projection method according to this invention, in the above invention, the arbitrary part of the user that serves as the screen is the nail of the user's finger on the hand or the finger on the foot, which is a feature.

[0022] Also, in the image projection method according to this invention, in the above invention, the arbitrary part of the user that serves as the screen is a part of the user's body that the user can visually recognize using a mirror.

[0023] Also, in the image projection method according to this invention, in the above invention, when projecting the image onto a part that the user can visually recognize using a mirror, it is characterized by reversing the left and right of the image.

[0024] Furthermore, the image projection method according to this invention is characterized in that, in the above invention, the arbitrary part of the user that serves as the screen is the user's face, head, or neck.

[0025] Furthermore, the image projection method according to this invention is characterized in that, in the above invention, the arbitrary part of the user that serves as the screen is the torso or buttocks of the user.

[0026] Furthermore, the image projection method according to this invention is characterized by identifying the location of a user and any part of the user's body, and projecting an image transmitted or delivered to the user onto the clothing on the identified part, using it as a screen.

[0027] Furthermore, the image projection method according to this invention is characterized in that, in the above invention, the clothing includes at least one of the following: clothes, gloves, shoes, socks, hat, and mask.

[0028] Furthermore, the image projection method according to this invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the type or condition of clothing worn on the arbitrary part of the user that serves as the screen.

[0029] Furthermore, the image projection method according to this invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on at least one of the color and material of the clothing worn on any part of the user that serves as the screen.

[0030] To solve the above-mentioned problems and achieve the objective, the image projection device according to this invention is characterized by comprising a control unit that identifies the location of a user and any part of the user's body, and projects an image transmitted or delivered to the user onto the identified part, using the identified part as a screen.

[0031] Furthermore, the image projection device according to this invention is characterized by comprising a control unit that identifies the location of a user and any part of the user's body, and projects an image transmitted or delivered to the user onto the clothing on the identified part, using the clothing as a screen.

[0032] Furthermore, the image projection device according to this invention is characterized in that, in the above invention, the control unit moves the image projection device that projects the image to a position where the image can be projected onto the arbitrary part.

[0033] To solve the above-mentioned problems and achieve the objective, the unmanned aerial vehicle according to this invention is characterized by identifying the location of the user and any part of the user's body, and projecting an image transmitted or delivered to the user onto the identified part, which is used as a screen.

[0034] Furthermore, the unmanned aerial vehicle according to this invention is characterized by identifying the location of the user and any part of the user's body, and projecting the transmitted or delivered image onto the clothing on the identified part of the body, using it as a screen.

[0035] Furthermore, the unmanned aerial vehicle according to this invention is characterized in that, in the above invention, it moves to a position where the image can be projected onto the arbitrary part, and projects the image.

[0036] To solve the above-mentioned problems and achieve the objective, the image projection program according to this invention is characterized by causing an image projection device to perform a process of identifying the location of a user and any part of the user's body, and projecting an image transmitted or delivered to the user onto the identified part, which is used as a screen.

[0037] Furthermore, the image projection program according to this invention is characterized by causing an image projection device to perform a process of identifying the location of a user and any part of the user's body, and projecting an image transmitted or delivered to the user onto the clothing on the identified part, using the clothing as a screen.

[0038] Furthermore, the image projection program according to this invention is characterized in that, in the above invention, it causes the image projection device to perform a process of moving the image projection device that projects the image to a position in which the image can be projected onto the arbitrary part. [Effects of the Invention]

[0039] The image projection method, image projection device, unmanned aerial vehicle, and image projection program according to this invention have the effect of allowing users to view image information even if they do not carry a display device such as a mobile terminal, or even if there is no display device such as a display or screen nearby. [Brief explanation of the drawing]

[0040] [Figure 1] This is an explanatory diagram (part 1) showing an overview of the image projection method ("Palmtop Screen"). [Figure 2] This is an explanatory diagram (part 2) showing an overview of the image projection method ("drone projector"). [Figure 3] This is an explanatory diagram (part 3) showing an overview of the image projection method ("Palmtop Screen"). [Figure 4] This is an explanatory diagram (part 4) showing an overview of the image projection method ("arm-top screen"). [Figure 5] This is an explanatory diagram (part 5) showing an overview of the image projection method ("list-top screen"). [Figure 6] This is an explanatory diagram showing an example of the appearance of an image projection device (drone projector). [Figure 7] This is an explanatory diagram showing an example of the hardware configuration of an image projection device. [Figure 8]This is a block diagram showing an example of the functional configuration of an image projection device. [Figure 9] This flowchart shows an example of the processing procedure for an image projection device. [Figure 10] This is an explanatory diagram showing an example of an image projection device (movable projector) and a movable environment for the image projection device according to another embodiment of the present invention. [Modes for carrying out the invention]

[0041] Preferred embodiments of the image projection method, image projection apparatus for implementing the image projection method, unmanned aerial vehicle, and image projection program according to the present invention will be described in detail below with reference to the attached drawings.

[0042] (Overview of image projection methods) Figures 1 to 5 are explanatory diagrams illustrating an overview of the image projection method. In Figure 1, image information 110 related to a video call is projected onto the user's right hand 101. Image information 120 related to a chat screen is projected onto the left hand 102. However, the user can project any desired image information onto the right hand 101 and left hand 102. For example, image information 110 related to video calls with different people may be projected onto each of the right and left hands 101 and 102. In this way, an image is projected onto the palm of at least one of the user's hands. The inventor has named the use of the palm as a screen "Palm Top Screen".

[0043] Audio accompanying image information, such as the voice of the video call participant when projecting images related to a video call, can be output from earphones worn by the user or from speakers placed around the user. The speakers may be mounted on the image projection device 200 shown in Figure 2 (speaker 707 shown in Figure 7, described later). In addition, the user's voice can be input (collected) from earphones worn by the user or from a microphone placed around the user. The microphone may be mounted on the image projection device 200 (microphone 706 shown in Figure 7, described later).

[0044] Figure 2 shows the image projection device 200 projecting image information 110 related to a video call onto the palm of user 201. As shown in Figure 2, by projecting the image information 110 from the image projection device 200 onto the palm of user 201, any part of user 201's body, such as the palm, can be used as a screen. The image projection device 200 is mounted on a drone (unmanned aerial vehicle), which flies and stops in a predetermined space, and from there projects the image information onto the palm of user 201, any part of their body. The inventor named this image projection device 200 the "Drone Projector" (abbreviated as "DroPro").

[0045] By using the palm of the hand as a screen, a dedicated display device is not required to view image information. Depending on the direction the palm is facing, it is possible to prevent others nearby from peeking at the image information. Also, depending on the direction the palm is facing, it is possible to share and view the image information with others sitting next to or across from you.

[0046] As shown in Figure 1, by using both hands, the user can view at least two different screens simultaneously. To display two different image information, one drone may be equipped with two or more projectors, or multiple drone projectors may be used, each projecting from a different location. Furthermore, as shown in Figure 2, by bringing both hands close together or touching them, a single image can be enlarged and displayed across both hands.

[0047] As can be seen from Figures 1 and 2, these image information 110 and 120 are projected images projected from the image projection device 200 onto an outstretched palm. In order to project the image information 110 and 120 onto the palm of user 201, the image projection device 200 first identifies the user 201 onto whom the image information should be projected. Then, it identifies the position of the identified user 201's palm and projects the transmitted image onto the identified palm, using the palm as a screen. As a result, user 201 can see the image information 110 and 120 projected onto their palm.

[0048] As shown in Figure 3, the orientation of the image information 110 may be determined by the relationship between the user's line of sight (position of both eyeballs) and the position of the palm 101. Therefore, regardless of the direction the fingertips are pointing, the orientation of the image information may be determined by inferring an angle that is easy for the user to view from the positions of the user's left and right eyeballs. In Figure 3, it can be seen that the orientation in which the image 110 is projected on the palm is different from that in Figure 1. The orientation of the image 110 is changed depending on the direction in which the user 201 extends their right hand 101. Therefore, even if the angle of the user 201 changes, the orientation in which the image is projected relative to the user 201's line of sight remains constant, thus improving the visibility of the image information 110.

[0049] Furthermore, the orientation in which the image information is projected may be changed by user 201's voice (for example, "make it visible to the person across from me") or gestures (for example, by flipping the image information upside down). This makes it easier for not only user 201 but also others sitting next to or across from them to see the image information.

[0050] If the angle of the palm changes or the position of the palm moves, the image projection device 200 recognizes the change and continues to project image information onto the palm in accordance with the change in the angle and position of the palm. Therefore, until the user 201 gives an instruction to stop projection, image information can be continuously projected onto the palm, similar to how it would be displayed on a display device, for example.

[0051] The dimensions of the image information may be determined based on the size and shape of the user's palm. The dimensions of the image information when projected onto the palm may be predetermined for each user. This ensures that the same dimensions of image information are always displayed on the palm, reducing the likelihood that user 201 will feel any discomfort each time they view the image information.

[0052] Furthermore, the dimensions of the image information may be changed according to the user 201's instructions. User 201's instructions for changing dimensions may be voice (for example, saying "make it bigger" or "make it smaller") or gesture (for example, pointing to the desired size with a finger). Voice may be collected by a microphone 706 mounted on the image projection device 200, and the user 201's instructions may be determined by voice recognition or the like. Gestures may be captured by a camera mounted on the image projection device 200, etc. (camera 603 shown in Figures 6 and 7 described later), and the user 201's instructions may be determined by image recognition or the like.

[0053] Image reception notifications are made by chimes, alarms, or voice messages (e.g., "You have a message from [Name]"). The voice message can be output to the speaker 707 shown in Figure 7 (described later) or to the user's earphones. Image reception notifications may also be made by emitting light or by vibrating an item the user possesses. Furthermore, the drone projector 200 may fly in front of the user 201 to provide notification.

[0054] When notification of image reception is received, user 201 gives an instruction to start projection. Specifically, the instruction to start projection can be given by, for example, uttering a word ("Show it") or by a predetermined gesture. Next, user 201 gives an instruction for the projection location. Specifically, the instruction for the projection location can be given by, for example, uttering a word ("The back of my left hand") or by a gesture (spreading the palm upwards, making a gesture of looking at a wristwatch, pointing to the desired location with a finger). The instruction to start projection and the instruction for the projection location may be a series of actions. (For example, uttering "Show it on my left thigh," and also pointing to the left arm with the index finger of the right hand.) In this way, the intention of user 201 can be confirmed.

[0055] Figure 4 shows an example of projection onto a part of user 201's body other than the palm. As shown in Figure 4, depending on the display format of the image information, the image information may be displayed in a long, continuous manner, for example, from near the left wrist along the arm towards the shoulder. The inventor has named this use of the arm as a screen "Arm Top Screen." In Figure 4, the arm top screen 400 displays map information as an example of image information. In this way, by utilizing the length of the arm, a relatively large image can be displayed, enabling a more user-friendly navigation function. In addition to map information, the arm top screen 400 can also project long, vertical images, such as a chat screen (with many chats), by raising the arm.

[0056] (An example of a body part onto which image information is projected) The body part onto which the image information is projected can be any body part that is visible to user 201. The body part onto which the image information is projected may be user 201's hand or arm. However, the hand is not limited to the palm. Specifically, it may be, for example, the back of the hand (not shown in the illustration). The inventor has named the use of the back of the hand or other parts of the body other than the palm as a screen "HAND TOP SCREEN".

[0057] Furthermore, the body part onto which the image information is projected may be, for example, a finger. The inventor has named the use of a finger as a screen a "FINGER TOP SCREEN." The part of the finger onto which the image is projected may be the palm side, the back of the hand, both sides, or the area between the palm and the back of the hand. Additionally, textual information, such as a message of one to three lines, can be displayed along the length of the finger. Different textual information may be displayed on each finger, or continuous textual information may be displayed on each finger.

[0058] Furthermore, a "nail top screen" ("NAIL TOP SCREEN"), which uses a fingernail as a screen, may be included as an example of a "finger top screen." By using a nail, which is harder and shinier than skin, as a screen, images can be projected more clearly. By pre-determining which fingernail the image will be projected onto depending on the recipient, the recipient of the image information can be instantly and intuitively identified (for example, the thumbnail of the right hand for person A, the middle fingernail of the left hand for person B). Alternatively, the fingernail to be projected onto may be pre-determined based on the content of the image information. For example, urgent messages could be projected onto the thumbnail of the right hand.

[0059] Another example of the user's hand or arm as the body part onto which the image information is projected is the wrist, as shown in Figure 5. The inventors have named the use of the wrist as a screen "LIST TOP SCREEN". As shown in Figure 5, the LIST TOP SCREEN 500 projects the image information at approximately the same position as the display on a wristwatch. Therefore, the user can view the LIST TOP SCREEN 500 with the same sensation as viewing the display on a wristwatch. The LIST TOP SCREEN 500 may be the wrist on the back of the hand, as shown in Figure 5, or the wrist on the palm side, or the wrist portion between the back of the hand and the palm side.

[0060] Furthermore, the body part onto which the image information is projected may be the legs or feet of user 201. For example, if user 201 is sitting, the legs or feet can be used as a screen to easily view the projected image. Specifically, this may be a "laptop screen" (the knee, or the leg from the knee to the hip when sitting in a chair, etc.), a "leg top screen" (the entire leg, such as the calf when crossing the legs), or a "foot top screen" (the instep, sole, toes, etc.). The ankle is included in either the "leg top screen" or the "foot top screen".

[0061] Because the legs or feet offer a relatively larger screen area compared to the hands or arms, they can project larger images. Furthermore, using them in conjunction with the hands or arms allows for the viewing of more image information.

[0062] Furthermore, similar to fingernails, a "nail-top screen" using toenails as a screen may also be included as an example of a "foot-top screen."

[0063] Furthermore, the body parts onto which the image information is projected may be body parts that are normally difficult to see but can be seen using a mirror or similar means (for example, the user's own face ("FACE TOP SCREEN"), especially the cheeks), the head ("HEAD TOP SCREEN"), especially the forehead or the area where hair grows), the neck ("NECK TOP SCREEN"), or the shoulders ("SHOULDER TOP SCREEN"). These names were all coined by the inventor.

[0064] Furthermore, the body parts onto which the image information is projected include the torso, such as the back ("BACK TOP SCREEN") and the abdomen ("ABD TOP SCREEN"), as well as the buttocks ("HIP TOP SCREEN"). It may also be called "TOP SCREEN" or similar. These names were also given by the inventor. When using a mirror or similar, image information that has been mirror-reversed (the left and right sides of the image are reversed) can be projected. The nose and ear are included in the "face top screen".

[0065] In particular, by projecting images onto the user's own face ("face top screen"), neck ("neck top screen"), shoulders ("shoulder top screen"), or head ("head top screen") using mirrors, the user can, for example, check the image information while applying makeup, washing their hair, or getting a haircut.

[0066] Furthermore, if the area being examined is the torso or buttocks, user 201 can view the image information while looking at their entire body in a mirror.

[0067] As an application of these technologies, image information can be used for images related to makeup, clothing, accessories (such as glasses), ornaments (such as necklaces), and tattoos. This image information can be projected directly onto the user's body parts, allowing them to enjoy virtual makeup application and trying on clothes. It can also be used during surgical procedures, for example, to display the location of a wound on the corresponding body part. Furthermore, by projecting an ideal body shape directly onto the body, it can be used as a goal for weight loss.

[0068] In this way, by using various parts of the user's body as screens, no dedicated device such as a screen is required to view images. Furthermore, the user does not need to carry an information terminal device with a display screen (it can be done "empty-handed").

[0069] The user selects which part of the body the image information is projected onto. This can be done verbally (e.g., saying "display it on the back of my right hand" or "on my left wrist") or by gesture (e.g., pointing to the desired projection location). The body part on which the image information is projected may also be selected based on the type of image information. For example, highly confidential information could be displayed on the palm of the hand, and the orientation and angle of the palm, as well as the distance from the face, could be adjusted to prevent those nearby from seeing the image content.

[0070] Furthermore, the system may allow the projection to be selected based on the user's posture. When sitting in a chair, for example, the projection can be placed on the knees or legs. If the user is holding an object or performing a task with one hand, the projection can be placed on the other hand or other body parts.

[0071] Image information may be projected directly onto the user's skin, or while wearing clothing, etc. If applicable, the image may be projected onto the clothing. The projection method (color, brightness, etc.) can be changed depending on whether the image is projected onto the skin or onto clothing. It can also be changed depending on the type of clothing (material, color, etc.). These differences can be determined by analyzing the image captured by the camera mounted on the image projection device.

[0072] (An example of the appearance of the image projection device 200) Next, an example of the external appearance of an image projection device according to an embodiment of the present invention will be described. Figure 6 is an explanatory diagram showing an example of the external appearance of an image projection device. As shown in Figure 6, the image projection device (drone projector) 200 comprises a projector (projection unit) 601, a drone (unmanned aerial vehicle) 602, a camera 603, and a human presence sensor 604. That is, the projector 601, the camera 603, and the human presence sensor 604 are mounted on the drone 602.

[0073] The projector 601 includes a projector light source, an optical system, a projection lens, etc. (all are not shown in the diagram). The projector 601 guides light emitted from the projector light source through the optical system to a predetermined path and projects an image onto the area where the light is irradiated by the projection lens 601a. ​​The optical system consists of an integrator lens that enhances the uniformity of the illuminance of the light emitted from the projector light source, a polarization conversion element that converts (polarizes) the light emitted from the non-polarized light source to a predetermined polarization direction, a dichroic mirror that separates the light from the projector light into the three primary colors R, G, and B, a liquid crystal panel that displays images corresponding to each of the R, G, and B colors of light, and a dichroic prism that synthesizes the images of each color displayed by each liquid crystal panel (all are not shown in the diagram).

[0074] For example, a laser projector that uses a laser as its light source can be used as the projector 601. By using a laser projector, the projector 601 can be made smaller. Specifically, laser projectors can keep the heat generation lower than mercury lamp projectors that use mercury lamps as their light source, so they can be made smaller and lighter by eliminating mechanisms such as cooling fans.

[0075] Furthermore, using a laser projector allows for quick startup and image projection. Additionally, using a laser projector allows for higher brightness of projected images while consuming less power than a mercury lamp projector.

[0076] Mercury lamp projectors are recommended to be used with the projection (optical axis) direction horizontal, thus limiting the freedom of projection direction. In contrast, laser projectors can be used with the optical axis tilted relative to the horizontal. Therefore, laser projectors can ensure a high degree of freedom in projection direction, allowing images to be projected not only onto walls but also onto the ground and floor.

[0077] The drone 602 moves the projector 601. By moving the projector 601 with the drone 602, also known as an unmanned aerial vehicle, the projection location of the image by the projector 601 can be changed. Specifically, the drone 602 can be a quadcopter equipped with four propellers 605, for example. The drone 602 is not limited to a quadcopter; it can also be a hexacopter with six propellers, an octocopter with eight propellers, or various other types of multirotors.

[0078] Projector 601 is fixed to drone 602, and the movement of drone 102 ( It moves in conjunction with flight. The projector 601 may be connected to the drone 602 in a manner that allows for attitude adjustment. Specifically, for example, the projector 601 can be connected to the bottom surface of the drone 602 via a universal joint such as a ball joint. By connecting the projector 601 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom for adjusting the attitude of the projector 601 can be ensured.

[0079] In this case, the image projection device 200 may include a drive mechanism for changing the orientation of the projector 601 relative to the drone 602, in order to adjust the orientation of the projector 601 relative to the drone 602 without human intervention. The drive mechanism can be configured, for example, by a motor or a gear train. By making the orientation of the projector 601 relative to the drone 602 adjustable, the image can be projected at an optimal angle depending on the location where the image is to be projected.

[0080] Camera 603 captures images of user 201 as shown in Figure 2, and also captures images projected by projector 601. Specifically, camera 603 can be implemented, for example, by a general-purpose digital camera. Camera 603 is fixed to drone 602 with its lens 603a pointed in the same direction as the image projection direction by projector 601.

[0081] The camera 603 may be connected to the drone 602 in a manner that allows adjustment of the direction in which the lens is pointed relative to the projection direction of the image by the projector 601. In Figure 6, the camera 603 can be rotated around the axis portion connecting it to the drone 602. The camera 603 may also be connected to the bottom surface of the drone 602 via a universal joint such as a ball joint. By connecting the camera 603 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the camera 603 can be ensured.

[0082] In this case, the image projection device 200 may be equipped with a drive mechanism that changes the attitude of the camera 603 relative to the drone 602 in order to adjust the direction in which the lens 603a is pointed without human intervention. The drive mechanism can be configured, for example, with a motor or a gear train. By making it possible to adjust the direction in which the lens 603a is pointed relative to the projection direction of the image by the projector 601, it is possible to capture images projected by the projector 601 or images of the surroundings of the image projection device 200 using a single camera 603.

[0083] In the image projection device 200, the drive mechanism for adjusting the attitude of the projector 601 relative to the drone 602 and the drive mechanism for adjusting the attitude of the camera 603 relative to the drone 602 may operate independently of each other. This makes it possible to project an image with the projector 601 while simultaneously capturing the projected image with the camera 603, or to adjust the attitude of the camera 603 to capture an image in a direction different from the projection direction of the image.

[0084] The camera 603 is not limited to a general-purpose digital camera; for example, it may be implemented using a night vision camera that amplifies its sensitivity to light to capture images in dark places, or an infrared camera that is sensitive to infrared light. By incorporating such a camera 603, it is possible to clearly capture images of the user, any part of the user, or the image projected by the projector 601, even at night, without using an auxiliary light source for imaging. This helps to suppress increases in the weight and power consumption of the image projection device 600.

[0085] The motion sensor 604 detects a user who is within a predetermined range from the image projection device 200. The user is the object of viewing the image projected by the image projection device 200. The human presence sensor 604 can be specifically implemented by, for example, an infrared sensor. The infrared sensor detects the temperature rise (temperature change) caused by the absorption of infrared radiation emitted by the object to be detected, such as a user, by a temperature sensor, and outputs a predetermined electrical signal. By using an infrared sensor, it is possible to detect the presence or absence of a viewer and the movement of that viewer.

[0086] The user detection range of the human presence sensor 604, which is implemented by an infrared sensor, can be adjusted, for example, by adjusting the sensitivity of the infrared sensor, the number and arrangement of sensor elements (pixels), and the amplification factor of the current sensed by the sensor elements (pixels). The human presence sensor 604 is not limited to one implemented by an infrared sensor; for example, it may detect the user 201 using ultrasound or visible light, or it may detect the user 201 using a method that combines infrared and ultrasound.

[0087] Thus, the image projection device 200 is a drone projector that can move its position in space by flying, both indoors and outdoors. This drone projector may be a personal drone projector, or it may be a public drone projector shared by multiple users.

[0088] (Hardware configuration of the image projection device 200) Next, the hardware configuration of the image projection device 200 will be described. Figure 7 is an explanatory diagram showing the hardware configuration of the image projection device 200. As shown in Figure 7, the hardware of the image projection device 200 consists of a battery 701, a control circuit 702, a communication I / F 703, a GPS receiver 704, a motor 705, a projector 601, a camera 603, a motion sensor 604, a microphone 706, a speaker 707, and the like. The various parts 601, 603, 604, and 701-707 of the image projection device 200 are connected by a bus 700.

[0089] The battery 701 supplies power to operate the various parts of the image projection device 200. The battery 701 can be implemented as a secondary battery (rechargeable battery, storage battery), such as a lithium battery. The battery 701 implemented as a secondary battery may be detachable from the drone 602.

[0090] Furthermore, the image projection device 200 may be equipped with charging contacts for charging the battery 701. The charging contacts may be, for example, in the form of exposed terminals or in the form of a connector. Alternatively, the image projection device 200 may be equipped with, or in addition to, a power receiving coil for wireless power transfer (contactless power transmission) instead of the charging contacts for charging the battery 701.

[0091] Wireless power transfer is a technology that receives power to the battery 701 without using charging contacts, and is also called contactless power transfer or wireless power transfer. The power receiving coil is located inside the outer surface of the drone 602. This prevents deterioration and malfunction of the image projection device 200 due to water droplets such as rain and dew. The battery 701 may be implemented using a primary battery that only discharges DC power.

[0092] The control circuit 702 consists of a CPU, memory, and other components, and drives and controls each part of the image projection device 200. The CPU controls the entire image projection device 200 by executing programs stored in memory. The memory stores the programs executed by the CPU. The memory also contains, for example, image information related to the image to be projected. It stores various types of information.

[0093] The memory can be implemented in various ways, such as by IC memory or an SSD (Solid State Drive). Alternatively, the memory may be a memory card that is removable from the image projection device 200 via a card slot provided in the image projection device 200. The memory card can be an IC card, such as an SD (Secure Digital) memory card. The memory may also be implemented using an external hard disk or USB memory.

[0094] Specifically, the control circuit 702 includes, for example, a flight controller and an ESC (Electronic Speed ​​Controller). The control circuit 702 may also include a BEC (Battery Elimination Circuit) and a UBEC (Universal BEC). Furthermore, if the battery 701 is implemented using a secondary battery, the control circuit 702 may include a charging circuit for charging (storing energy) the battery 701.

[0095] The flight controller performs calculations related to the rotation control of motor 705 and outputs a control signal. The ESC controls the rotation of motor 705 based on the control signal output from the flight controller. During the flight of the image projection device 200, the flight controller repeatedly performs calculations based on the tilt of the image projection device 200 and recursively outputs a control signal for motor 705.

[0096] The flight controller outputs control signals to the ESC to control the rotation direction and speed of the propellers (propeller motors 705). Specifically, for example, it prevents the image projection device 200 from rotating by outputting control signals that control adjacent propellers to rotate in opposite directions. Also, for example, it moves the image projection device 200 forward by controlling the propellers in the direction of travel to rotate slower than the propellers in the direction of travel to rotate slower. Also, for example, it turns the image projection device 200 to the right by controlling the propellers on the right side of the direction of travel to rotate slower than the propellers on the left side of the direction of travel.

[0097] Furthermore, the control circuit 702 specifically includes, for example, a GPU (Graphics Processing Unit) dedicated to image processing for images projected by the projector 601. By including a GPU, fast-moving videos and other content can be projected in high quality.

[0098] Communication I / F 703 is an interface that connects the image projection device 200 and network N via a communication line. It controls the interface between network N and the internal workings of the image projection device 200, and controls the input of data from and output of data to external devices connected via network N. Network N can be implemented by, for example, the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network).

[0099] Communication I / F703 is a wireless interface, for example, Wi-Fi (registered trademark). Communication I / F703 also uses a mobile phone network (for example, LTE (Long Term)). It may also be a wireless communication interface such as Evolution or PHS (Personal Handy-phone System).

[0100] The control circuit 702 communicates with an external device via the communication interface 703, thereby obtaining various information from the external device, including, for example, image information related to the image to be projected. This can be achieved. In addition, the control circuit 702 may store the acquired information in memory or update the contents of the memory based on the acquired information each time it acquires various information from an external device.

[0101] The GPS receiver 704 determines the current position of the image projection device 200. Specifically, the GPS receiver 704 includes, for example, a GPS antenna, an RF (Radio Frequency) section, and a baseband section. The GPS antenna receives radio waves broadcast by GPS satellites. The RF section demodulates the unmodulated signal received by the GPS antenna into a baseband signal. The baseband section calculates the current position of the image projection device 200 based on the baseband signal demodulated by the RF section. The GPS receiver 704 may also include a filter to remove unwanted components and amplifiers such as an LNA (Low Noise Amplifier) ​​and a power amplifier PA (Power Amplifier).

[0102] The current position of the image projection device 200 can be determined by positioning based on radio waves transmitted from multiple GPS satellites. The baseband unit calculates the distance to each of the four GPS satellites and performs positioning by calculating the position where these distances intersect. Instead of GPS, which determines the geometric position between the GPS satellites and the image projection device 200 based on radio waves received from GPS satellites, the current position of the image projection device 200 may be determined using satellite positioning systems such as Michibiki, GLONASS, or Galileo.

[0103] Motor 705 is controlled by control circuit 702 and rotates to rotate propeller 605. Specifically, motor 705 can be a brushless motor in which the rotor is made of permanent magnets and the stator is made of coils. The number of motors 705 can be the same as the number of propellers 605. This allows each propeller 605 to be rotated independently, making the image projection device 200 move forward, backward, or rotate left or right.

[0104] If the projector 601 and camera 603 are equipped with drive mechanisms for adjusting their orientations, the control circuit 702 also controls the operation of the motors 705 of each of these drive mechanisms. This allows the image projection device 200 to move while independently (individually) adjusting the orientations of the projector 601 and camera 603.

[0105] As described above, the projector 601 guides light emitted from the projector light source through an optical system to a predetermined path and projects an image onto the area illuminated by the light by irradiating the area outside the projector 601 through the projection lens 601a. ​​The projector 601 may also adjust the image quality of the projected image by adjusting the intensity of the light emitted from the projector light source according to the distance from the position on which the image is projected. The distance between the projector 601 and the position on which the image is projected can be determined, for example, using a distance sensor. Various known sensors such as laser distance sensors, ultrasonic sensors, and infrared sensors can be used as distance sensors.

[0106] The camera 603 is equipped with an image sensor, and generates image information (shooting data) by converting light received by the image sensor through the shooting lens into an electrical signal. The generated image information is output to the control circuit 702. The camera 603 may shoot still images or may shoot videos. Videos include the continuous playback of still images taken at predetermined time intervals. The image information may be compressed according to a predetermined video / audio data compression standard (for example, MPEG (Moving Picture Experts Group)).

[0107] The motion sensor 604 outputs an electrical signal to the control circuit 702 that corresponds to the temperature change caused by the absorption of infrared rays by the light-receiving element. Specifically, the motion sensor 604 converts the current signal corresponding to the temperature change into a voltage signal and amplifies it, and when the amplified voltage signal exceeds a predetermined threshold, it outputs a predetermined electrical signal to the control circuit 702. The control circuit 702 detects the user 201 when it receives the input of the predetermined electrical signal output from the motion sensor 604.

[0108] Microphone 706 collects sound from the surrounding area of ​​the image projection device 200. Microphone 706 converts the sound input as analog data into an electrical signal. Specifically, microphone 706 converts the analog audio signal input as analog data from analog to digital and generates audio data in digital format.

[0109] Speaker 707 generates sound by vibrating a diaphragm in response to an electrical signal, which is an audio signal. Speaker 707 may also have an output terminal that outputs an audio signal, and an external speaker may be connected to this output terminal to generate sound.

[0110] The image projection device 200 may also include, although not shown in the illustration, LED lamps to indicate the status of the image projection device 200, and input / output devices such as keys or buttons for giving input instructions to the image projection device 200. The input / output devices may be implemented by connection terminals to which other information processing devices can be connected.

[0111] Furthermore, the image projection device 200 may also be equipped with a memory card interface (I / F) which is connected to the image projection device 200 via a card slot. The memory card interface controls the internal interface with the memory card and controls the input of data from and output of data to the memory card. This allows the image projected by the image projection device 200 to be stored on the memory card, and the image projected by the image projection device 200 can be switched simply by changing the memory card.

[0112] (An example of the functional configuration of the image projection device 200) Next, an example of the functional configuration of the image projection device 200 will be described. Figure 8 is a block diagram showing an example of the functional configuration of the image projection device 200. As shown in Figure 8, the functions of the image projection device 200 according to this embodiment of the present invention are realized by a user instruction receiving unit 801, a projection target user identification unit 802, a body part information acquisition unit 803, a projection image information acquisition unit 804, a body part identification unit 805, a projection position / projection dimension determination unit 806, a warning output unit 807, a movement position / projection angle determination unit 808, a movement / projection angle control unit 809, an image information projection unit 810, a projection image capture unit 811, and an instruction output unit 812. Therefore, the functions of the control unit of the image projection device 200 can be realized by these components 801 to 812.

[0113] The user instruction receiving unit 801 receives an instruction from user 201 to project image information. It then outputs the received projection instruction to the target user identification unit 802. Specifically, the user instruction receiving unit 801 can be implemented using, for example, the camera 603, microphone 706, control circuit 702, and communication I / F 703 shown in Figures 6 and 7. The user instruction receiving unit 801 can also receive an instruction to end projection. It outputs the received projection end instruction to the image information projection unit 810.

[0114] Furthermore, the user instruction receiving unit 801 can receive various operation instructions for the projected image information. The received instructions can be output (transmitted) to the outside from the instruction output unit 812. In addition, all or part of the user's instructions may be transmitted directly to the outside without going through the image projection device 200.

[0115] The projection target user identification unit 802 identifies the projection target user who has received a projection instruction from the user instruction receiving unit 801. Specifically, the projection target user identification unit 802 can implement its functions using, for example, the camera 603, microphone 706, control circuit 702, and communication I / F 703 shown in Figure 7. The projection target user identification unit 802 identifies the projection target user as follows.

[0116] In the case of a user-dedicated image projection device 200, user information (ID information transmitted by the user or information identified from the user's physical characteristics) is stored in advance, and the user's current location is determined based on that information. The user's location is tracked at regular time intervals. If the user moves, their new location is also captured.

[0117] In the case of a shared image projection device, user information is received, and the corresponding user 201 is searched for based on that information. The search for user 201 may be performed, for example, based on the location information of user 201 calculated based on the user ID signal transmitted by user 201. Alternatively, the search for user 201 may be performed by identifying the corresponding user 201 by analyzing images captured by camera 603 based on information relating to the physical characteristics of user 201. If the current location of user 201 is found, the current location of that user 201 is identified and monitored at regular time intervals. If user 201 moves, its new location is then captured.

[0118] The projection target user identification unit 802 outputs information about the identified projection target user 201, specifically the user's location information, to the body part identification unit 805.

[0119] The body part information acquisition unit 803 acquires information about body parts that will serve as screens for projecting image information. Specifically, the body part information acquisition unit 803 can perform its function using, for example, the camera 603, microphone 706, and communication I / F 703 shown in Figure 7. When a body part is specified by the user 201, the body part information acquisition unit 803 acquires the specified information using the camera 603, microphone 706, communication I / F 703, etc. The body part information acquisition unit 803 outputs the acquired body part information to the body part identification unit 805.

[0120] The projection image information acquisition unit 804 acquires image information to be projected. Specifically, the projection image information acquisition unit 804 can perform its function by, for example, the communication I / F 703 shown in Figure 7. The projection image information may be a still image or a video. The acquired image information also includes information about the content (profile) of the image. Specifically, this includes the type of image (e.g., chat or video call), the resolution of the image, and the amount of data. The projection image information acquisition unit 804 outputs the acquired image information to the image information projection unit 810. It also outputs information about the content of the image from the acquired image information to the body part identification unit 805 and the projection position / projection dimension determination unit 806.

[0121] The body part identification unit 805 identifies the body part that will serve as the screen for projecting image information, based on information about the user to be projected onto, identified by the projection target user identification unit 802, information about the body part acquired by the body part information acquisition unit 803, and the body part that will serve as the screen for projecting image information. Furthermore, it may also identify the body part based on information about the content of the image acquired by the projection image information acquisition unit 804. For example, if the image is relatively large, even if user 201 has specified the palm, it can be changed to the arm. In that case, the user can also be notified (projected) that the specified body part has been changed. Specifically, the body part identification unit 805 can be realized by, for example, the camera 603 shown in Figures 6 and 7, the human presence sensor 604, and the control circuit 702 shown in Figure 7.

[0122] The body part identification unit 805 specifically identifies a body part as follows: If the body part is the palm of the hand, first, if there is an instruction to project image information, it identifies the position of the user's palm, whose position is known. Position identification is performed by analyzing the image captured by the camera 603 mounted on the image projection device 200. Alternatively, a human presence sensor 604, such as an infrared sensor, may be used to identify the position as an alternative to or supplement to the camera. Specifically, the user's orientation and posture are determined from the positions of various parts of the user's body, such as the head, shoulders, and arms, and the position of the user's palm is estimated.

[0123] Then, the position of the palm is determined based on the shape of the palm. Furthermore, the system may authenticate that the palm belongs to the user based on the physical characteristics of the palm (finger length, fingerprints, palm lines, veins, etc.).

[0124] The body part identification unit 805 identifies the body part (palm) in this manner. Other body parts can be identified based on their respective characteristics. The body part identification unit 805 outputs information about the identified body part to the projection position / projection dimension determination unit 806.

[0125] The projection position / projection dimension determination unit 806 determines the projection position for projecting image information and the dimensions of the projected image based on the body part identified by the body part identification unit 805. Alternatively, it may refer to the content of the image information acquired by the projection image information acquisition unit 804 and determine the projection position for projecting image information and the dimensions of the projected image based on that content. Specifically, the projection position / projection dimension determination unit 806 can be implemented, for example, by the control circuit 702 shown in Figure 7.

[0126] Specifically, the projection position / projection dimension determination unit 806 may determine the projection position and projection orientation based on information regarding the position of the user 201's palm relating to a body part identified by the body part identification unit 805, taking into account the direction of the fingers, the angle of the wrist, etc. Alternatively, it may determine the size of the palm from information regarding the user 201's palm relating to a body part identified by the body part identification unit 805, and determine the dimensions of the image information to be projected so that the image fits within the palm.

[0127] Furthermore, the projection position / projection dimension determination unit 806 may change the projection method for projecting the image based on the state of the body part identified by the body part identification unit 805. Specifically, the state of the body part may be, for example, wearing gloves. The projection position / projection dimension determination unit 806 outputs information regarding the determined projection position, projection dimensions, etc., to the movement position / projection angle determination unit.

[0128] Furthermore, if the projection position / projection dimension determination unit 806 determines that projection is not possible on the palm based on the direction of the fingers, the angle of the wrist, etc., it outputs information to the warning output unit 807 indicating that projection is not possible, as well as information prompting the user to change the position of their palm.

[0129] The warning output unit 807 outputs a warning to the effect that projection is not possible on a body part identified by the body part identification unit 805 when the projection position and projection dimension determination unit 806 determines the projection position and projection dimensions, and prompts the user to move their position or the position of the body part. Specifically, the function of the warning output unit 807 can be realized by, for example, the communication I / F 703 and speaker 707 shown in Figure 7.

[0130] The movement position / projection angle determination unit 808 determines at least one of the movement position of the image projection device 200 and the projection angle of the image projection device 200 based on the projection position and projection dimensions determined by the projection position / projection dimension determination unit 806. Specifically, the function of 8 can be realized by, for example, the control circuit 702 shown in Figure 7. Specifically, the movement position / projection angle determination unit 808 calculates the latitude and longitude information of the position to be moved and the projection angle of the projector 601, and outputs the calculation result to the movement / projection angle control unit 809.

[0131] The movement and projection angle control unit 809 controls the motor 705 to move the image projection device 200 based on the movement position and projection angle determination unit 808. It also adjusts the projection angle of the image projection device 200 based on the movement position and projection angle determination unit 808. Specifically, the movement and projection angle control unit 809 can realize its functions using, for example, the control circuit 702, GPS receiver 704, and motor 705 shown in Figure 7.

[0132] The image information projection unit 810 projects the image information acquired by the projection image information acquisition unit 804 onto a specified body part as a screen. Furthermore, the projection of the image information may be stopped in response to a projection termination instruction received by the user instruction reception unit 801. Specifically, the image information projection unit 810 can be implemented, for example, by the projector 601 shown in Figures 6 and 7, the control circuit 702 shown in Figure 7, and so on.

[0133] The projection image capture unit 811 captures an image projected onto any body part as a screen, or captures or acquires information about the surrounding area of ​​the image. Specifically, the projection image capture unit 811 can perform its function using, for example, the camera 603 and human presence sensor 604 shown in Figures 6 and 7. The projection image capture unit 811 outputs the captured image or information about the surrounding area of ​​the image to the projection position / projection dimension determination unit 806.

[0134] The projection position / projection dimension determination unit 806 may change the projection method for projecting the image based on the surrounding conditions of any acquired part, and output information related to the changed projection method to the image information projection unit 810. Specifically, the surrounding conditions of any part may be the brightness of the surrounding area. If the surrounding area is relatively bright, the illuminance of the projected image may be increased. On the other hand, if the surrounding area is relatively dark, such as at night, the illuminance of the projected image may be decreased.

[0135] The projection position / dimension determination unit 806 may recognize (analyze) the image captured by the projection image capture unit 811 and change the projection method based on the recognized image. Specifically, if the image quality of the projected image is degraded or the user 201 has difficulty viewing the image, the projection position or dimensions may be changed to improve visibility. Information regarding the changed projection method may then be output to the image information projection unit 810.

[0136] The instruction output unit 812 outputs information regarding user 201's instructions on projected image information, which is received by the user instruction receiving unit 801. Specifically, the instruction output unit 812 can implement its function using, for example, the communication I / F 703 shown in Figure 7. Alternatively, the instruction information may be transmitted to each component via the bus 700.

[0137] (An example of the processing procedure for the image projection device 200) Next, an example of the processing procedure of the image projection device 200 will be described. Figure 9 is a flowchart of an example of the processing procedure of the image projection device 200. In the flowchart of Figure 9, the image projection device 200 first identifies the current location of the user to whom the image information will be projected (step S901).

[0138] Next, information is obtained about the body part of the identified user to which the image information will be projected (step S902). Then, based on the obtained information about the body part, the current position and orientation of the body part to be projected are determined (step S903). Then, based on the position and orientation of the identified body part, it is determined whether or not it is possible to project the image information onto the body part corresponding to that position and orientation (step S904).

[0139] If it is determined in step S904 that projection is not possible (step S904: No), a warning is issued to the user to whom projection is not possible (step S905). This prompts the user to move or change the position or orientation of their body parts. After that, the process returns to step S901 and steps S901 to S905 are repeated.

[0140] In step S904, if it is determined that projection is possible (step S904: Yes), the projection position and projection dimensions of the image information to be projected are determined (step S906). Then, based on the determined projection position and projection dimensions of the image information, the projection position of the image projection device 200 is determined (step S907).

[0141] Next, the image projection device (self-device) 200 is moved to the determined projection position and the projection angle is adjusted (step S908). After the movement and adjustment are complete, the image information is projected onto the (specified) body part as a screen (step S909).

[0142] Subsequently, it is determined whether the position and orientation of the body part to be projected have changed (step S910). This determination can be made, for example, by performing identification by the body part information identification unit 803 shown in Figure 8 at predetermined intervals (e.g., 0.5 seconds) and making a determination based on the difference with the information regarding the position of the body part identified previously (e.g., 0.5 seconds ago). If it is determined that the position and orientation of the body part to be projected have changed (step S910: Yes), the process returns to step S903, the position and orientation of the body part to be projected are identified again (step S903), and the processing from step S904 onwards is carried out.

[0143] If it is determined in step S910 that the position and orientation of the body part to be projected have not changed (step S910: No), then it is determined whether or not the body part to be projected has changed (step S911). The determination of whether or not the body part to be projected has changed can be made, for example, based on the information acquired by the body part information acquisition unit 803 shown in Figure 8. If the body part to be projected has changed (step S911: Yes), the process returns to step S902, and information regarding the body part to be projected is acquired again (step S902), and then the processing from step S903 onwards is carried out.

[0144] In step S911, if the body part to be projected has not changed (step S911: No), the next step is to determine whether the projected user has moved (step S912). The determination of whether the projected user has moved can be made, for example, by performing identification by the projected user identification unit 802 shown in Figure 8 at predetermined intervals (e.g., every 0.5 seconds) and making a determination based on the difference with the information regarding the position of the projected user identified previously (e.g., 0.5 seconds ago). If the projected user has moved (step S912: Yes), the process returns to step S901, the current position of the projected user is identified again (step S901), and then the processing from step S902 onward is carried out.

[0145] In step S912, if the user to be projected has not moved (step S912: No), then it is determined whether or not a projection termination instruction has been given (step S913). The determination of whether or not a projection termination instruction has been given is made, for example, by the projection termination instruction from the user instruction receiving unit 801. This can be determined by whether or not an instruction to end projection has been given. If there is no instruction to end projection (step 913: No), the process proceeds to step S910, and thereafter, each process from steps S910 to S913 is repeated. On the other hand, if an instruction to end projection has been given (step S913: Yes), the projection of image information is stopped (step S914), and the series of processes is terminated.

[0146] In this way, the image projection device 200 can project an image onto any part of the user 201's body. Furthermore, image projection can continue even if the position or orientation of the body part changes, if the body part to be projected changes, or if the user 201 moves.

[0147] <Another embodiment> While the drone projector 200 has been described as an image projection device, the image projection device is not limited to this. For example, it may be an image projection device that is movably mounted on an indoor wall or ceiling. The inventor named this image projection device a "movable projector (abbreviated as MubaPro)". The movable projector has a variable projection direction, and the projector itself is movable on walls and ceilings.

[0148] Figure 10 is an explanatory diagram showing an example of an image projection device (movable projector) 1000 and a moving environment for the image projection device 1000 in another embodiment of the present invention. In Figure 10, the same parts as those in the image projection device 200 in the above-described embodiment are indicated by the same reference numerals. As shown in Figure 10, the image projection device (movable projector) 1000 includes a movable body 1001. The movable body 1001 includes a main body 1002, rolling elements 1003, a magnet 1004, and a slide shoe 1005.

[0149] The main body 1002 has a roughly box-like shape and houses the control circuit 702, antenna, motor, battery, etc. inside. The control circuit 702 consists of a CPU, memory, etc., and drives and controls each part of the image projection device 1000. Specifically, for example, it drives and controls the motor 705 connected to the rolling element 1003 to rotate the rolling element 1003 and move the image projection device 1000.

[0150] The rolling elements 1003 are rotatably (rollingly) connected to the main body 1002. The rolling elements 1003 protrude from the end face of the main body 1002 toward the ceiling 1006 or wall 1007. It is preferable that there are three or more rolling elements 1003. This allows the image projection device 1000 to move stably and smoothly.

[0151] The rolling elements 1003 can be specifically implemented by, for example, rollers, balls, or rollers. By implementing the rolling elements 1003 by balls or rollers, the turning radius of the moving body 1001 can be reduced, allowing for tighter turns and ensuring a high degree of freedom in movement. When implementing the rolling elements 1003 by rollers, the toe angle and caster angle are adjusted as appropriate.

[0152] The magnet 1004 is located on the same side as the rolling element 1003 relative to the main body 1002. The magnet 1004 attracts the image projection device 600 to the ceiling 1006 or wall 1007 by magnetic force. The slide shoe 1005 is in the shape of a sheet or a flat plate. The slide shoe 1005 is made of a material that does not impair the magnetic force of the magnet 1004 that attracts the image projection device 1000 to the ceiling 1006 or wall 1007, and does not create resistance when the image projection device 600 moves. Specifically, the slide shoe 1005 can be made using, for example, hard silicone rubber.

[0153] The slide shoe 1005 is positioned such that the end face opposite the main body is at the same position as, or slightly closer to, the main body than, the tip of the rolling element 1003 (the contact point of the rolling element 1003 with the ceiling 1006 or wall 1007). This ensures that the rolling element 1003 makes reliable contact with the ceiling 1006 or wall 1007, allowing the image projection device 600 to move smoothly.

[0154] The slide shoe 1005 may be provided so as to be able to move toward and away from the magnet 1004 or the main body 1002. Specifically, for example, the slide shoe 1005 may be connected to the magnet 1004 or the main body 1002 via an elastic member such as a spring. This ensures that the rolling element 1003 can be reliably brought into contact with the ceiling 1006 or the wall 1007, and the image projection device 600 can be moved smoothly.

[0155] Such an image projection device 1000 may determine its current location using a GPS receiver 704 as described above, but is not limited to this. The image projection device 1000 may also determine its current location using, for example, the principle of triangulation used in PHS (Personal Handy-phone System). Specifically, for example, multiple PHS base stations (not shown) are installed on the ceiling 1006 or wall 1007, and the device's location is determined by receiving radio waves emitted from these base stations via an antenna.

[0156] This allows for highly accurate positioning and control of the image projection device 1000, even in environments where it is difficult to receive radio waves from GPS satellites due to the presence of the ceiling 1006 and walls 1007. As a result, the image 502 can be projected to any location within the building. Since the image projection device 1000 moves along the ceiling 1006 and walls 1007, collisions with the user 201 are reliably prevented, ensuring the safety of the user 201.

[0157] In this way, the image projection device 1000 can be moved using indoor equipment. The indoor equipment can be at least one of the indoor walls, ceilings, or floors, and the image projection device 1000 can be moved along the indoor equipment. This allows the image projection device 1000 to be moved to a desired position indoors and an image to be reliably projected onto any part of the user 201.

[0158] Furthermore, in yet another embodiment, the image projection device may be a projector attached to the user 201's body, although this is not shown in the illustration. For example, a rechargeable projector may be built into or attached to glasses or a hat worn by the user 201.

[0159] Alternatively, it may be a portable information terminal device (such as a smartphone) type projector that is held and operated with one hand. In that case, the portable information terminal device may be owned by the user, or it may be owned by someone other than the user.

[0160] As described above, the image projection method according to the embodiment of this invention is characterized by identifying the location of user 201 and any part of user 201's body (for example, reference numeral 101, 102, etc.), and projecting the transmitted or delivered image onto the identified part, which is used as screens 110, 120, 400, 500. As a result, the body can be used as a screen, so images can be viewed even without carrying a display device such as a mobile terminal, or even without display devices such as displays or screens in the surrounding area.

[0161] Furthermore, the image projection method according to the embodiment of this invention further involves moving the image projection devices 200, 1000 that project the image to a position where the image can be projected onto any part of the body. This feature ensures that an image can be reliably projected onto any desired part of the user 201.

[0162] Furthermore, the image projection method according to this embodiment of the invention is characterized by moving the image projection device 200 using an unmanned aerial vehicle 602. This allows the unmanned aerial vehicle to fly freely in three-dimensional space and move the image projection device 200 to a desired position.

[0163] Furthermore, the image projection method according to the embodiment of this invention is characterized by moving the image projection device 1000 using indoor equipment. In addition, the indoor equipment may be at least one of the indoor walls, ceilings, and floors, and the image projection device 1000 may be moved along the indoor equipment. This makes it possible to move the image projection device 1000 to a desired position indoors and reliably project an image onto any part of the user 201.

[0164] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that any part of the user 201 that serves as the screen is set according to the user 201's designation. This allows the user 201 to project an image to a position of their choice and view the image.

[0165] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that any part of the user 201 that serves as the screen is selected based on the content of the image. This makes it possible to use the most suitable part of the user 201 for the image as the screen, thereby improving the visibility of the image.

[0166] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that the projection method is changed based on the state of any part of the user 201 that serves as the screen. This allows the system to recognize the state of any part, specifically, for example, whether the palm of the hand is bare or wearing gloves, and to change the projection method accordingly, thereby achieving more optimal projection and improving the visibility of the image.

[0167] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that the projection method is changed based on the surrounding conditions of any part of the user 201 that serves as the screen. This makes it possible to recognize differences in the surrounding conditions of any part, specifically, differences such as ambient brightness and the density of people, and to change the projection method according to these differences, thereby achieving more optimal projection and improving the visibility of the image.

[0168] Furthermore, the image projection method according to the embodiment of this invention is characterized in that, in the above invention, the image projected onto the screen is recognized, and the projection method is changed based on the state of the recognized image. This makes it possible to photograph the projected image, analyze the photographed image, and change the projection method to correct the projected image based on the analysis results, thereby achieving more optimal projection and improving the visibility of the image.

[0169] Furthermore, the image projection method according to the embodiment of this invention is characterized in that, in the above invention, any part of the user 201 that serves as the screen is a part of the user 201's body that is visible to the user 201. For example, any part of the user 201 that serves as the screen is the user 201's hand or arm. This makes it possible to easily create a screen simply by moving the hand or arm, and to project images more quickly.

[0170] Also, for example, any part of user 201 that acts as a screen may extend to user 201's legs. The projected image is characterized by being a foot. This allows the user 201 to easily view the projected image, for example, when they are sitting. Also, because the leg or foot has a relatively larger screen area compared to the hand or arm, the image can be projected on a larger size.

[0171] Furthermore, the system is characterized in that, for example, any part of user 201 that serves as the screen is the fingernail or toenail of user 201. By using nails, which are harder and glossier than skin, as a screen in this way, images can be projected more clearly.

[0172] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that any part of the user 201 that serves as the screen is a part of the user 201's body that the user 201 can see using a mirror. This allows the user 201 to use their own body reflected in the mirror as a screen, and to view the content of the image at the same time as looking in the mirror.

[0173] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that, when the user 201 projects an image onto a part visible using a mirror, the left and right sides of the image are reversed. This eliminates the problem of text information being reversed and difficult to read when the image information is text.

[0174] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that the arbitrary part of the user 201 that serves as the screen is the user 201's face, head, or neck. This allows the user 201 to check the content of the image while looking at their own face or other body part in a mirror.

[0175] Furthermore, the image projection method according to this embodiment of the invention is further characterized in that the arbitrary part of the user 201 that serves as the screen is the torso or buttocks of the user 201. This allows the user 201 to check the content of the image while looking at their entire body in a mirror.

[0176] Furthermore, the image projection method according to the embodiment of this invention is characterized by identifying the location of user 201 and any part of user 201's body, and projecting the transmitted or delivered image onto the clothing on the identified part using it as a screen. For example, the clothing may include at least one of clothes, gloves, shoes, socks, hats, and masks. As a result, user 201 can use their clothing as a screen, and can view the image even if they are not carrying a display device such as a mobile terminal, or even if there are no display devices such as displays or screens around them.

[0177] Furthermore, the image projection method according to the embodiment of this invention is further characterized in that the projection method for projecting an image is changed based on the type or condition of clothing worn on any part of the user 201 that serves as the screen. For example, the projection method for projecting an image is changed based on at least one of the color and material of the clothing worn on any part of the user 201 that serves as the screen. This makes it possible to recognize differences in clothing color and material, change the projection method according to those differences, achieve more optimal projection, and improve the visibility of the image.

[0178] Furthermore, the image projection devices 200 and 1000 according to the embodiments of this invention are characterized by comprising a control unit (control circuit 702) that identifies the location of the user 201 and any part of the user 201's body, and projects an image transmitted or delivered to the user 201 onto the identified part, using it as a screen. As a result, the user 201 can use their body as a screen, and even without carrying a display device such as a mobile terminal, This means that images can be viewed even without display devices such as screens or displays in the surrounding area.

[0179] Furthermore, the image projection devices 200 and 1000 according to the embodiments of this invention are characterized by comprising a control unit (control circuit 702) that identifies the location of a user 201 and any part of the user 201's body, and projects an image transmitted or delivered to the user 201 onto the clothing ("clothes") on the identified part, using it as a screen. As a result, the user 201 can use their clothing as a screen, and can view images even without carrying a display device such as a mobile terminal, or even without any display devices such as displays or screens in their surroundings.

[0180] Furthermore, the image projection devices 200 and 1000 according to the embodiment of this invention are further characterized in that the control unit (control circuit 702) moves the image projection devices 200 and 1000 that project the image to a position where the image can be projected onto any part of the user 201. This ensures that the image is reliably projected onto any part of the user 201.

[0181] Furthermore, the unmanned aerial vehicle 602 according to the embodiment of this invention is characterized by identifying the location of user 201 and any part of user 201's body, and projecting an image transmitted or delivered to user 201 onto the identified part, using it as a screen. Furthermore, the unmanned aerial vehicle 602 according to the embodiment of this invention is characterized by having a control unit (control circuit 702) that identifies the location of user 201 and any part of user 201's body, and projects an image transmitted or delivered to user 201 onto the clothing on the identified part, using it as a screen. Moreover, the unmanned aerial vehicle 602 according to the embodiment of this invention is characterized by moving to a position where the image can be projected onto any part, and then projecting the image.

[0182] This allows the device to fly freely in three-dimensional space, move to a desired location, and project images. Since the user 201 can use their body or clothing as a screen, they can view images even without carrying a display device such as a mobile terminal, or even without any display devices such as displays or screens nearby.

[0183] Furthermore, the image projection program according to the embodiment of this invention is characterized by causing the image projection device to perform a process of identifying the location of user 201 and any part of user 201's body, and projecting an image transmitted or delivered to user 201 onto the identified part, which is used as a screen. Furthermore, the image projection program according to the embodiment of this invention is characterized by causing the image projection device to perform a process of identifying the location of user 201 and any part of user 201's body, and projecting an image transmitted or delivered to user 201 onto the clothing on the identified part, which is used as a screen. Moreover, the image projection program according to the embodiment of this invention is characterized by causing the image projection devices 200 and 1000 to perform a process of moving the image projection device that projects the image to a position where the image can be projected onto any part.

[0184] This allows the image projection devices 200 and 1000 to be moved to the desired position and project images. Since the user 201 can use their body or clothing as a screen, they can view images even without carrying a display device such as a mobile terminal, or even without any display devices such as displays or screens nearby.

[0185] The image projection method described in this embodiment can be implemented by running a pre-prepared program on a computer such as a personal computer or workstation. This program can be stored on a hard disk, CD-ROM, MO, or DV drive. The program is recorded on a computer-readable storage medium such as a USB memory stick or SSD, and executed when read from the storage medium by a computer. Alternatively, the program may be distributed via a transmission medium such as the internet. [Industrial applicability]

[0186] As described above, the image projection method, image projection device, unmanned aerial vehicle, and image projection program according to this invention are useful for image projection methods, image projection devices, unmanned aerial vehicles, and image projection programs that project images, and are particularly suitable for image projection methods, image projection devices, unmanned aerial vehicles, and image projection programs that project images using the human body as a screen. [Explanation of Symbols]

[0187] 110, 120 Palmtop Screen 200 Image projection device (drone projector) 201 users 400 Arm Top Screen 500 List Top Screen 601 Projector 602 Drone 603 Camera 604 Motion Sensor 801 User Instruction Reception Department 802 Projection target user identification unit 803 Body part information acquisition unit 804 Projection Image Information Acquisition Unit 805 Body part identification section 806 Projection position / projection dimension determination unit 807 Warning output section 808 Movement position / projection angle determination unit 809 Movement and Projection Angle Control Unit 810 Image Information Projection Unit 811 Projection Image Acquisition Unit 812 Instruction Output Section 1000 Image projection device (movable projector)

Claims

1. Identify the location of the user and any part of the user's body, An image projection method characterized by projecting an image transmitted or delivered to the user onto the identified arbitrary part, using that part as a screen.

2. The image projection method according to claim 1, characterized in that the image projection device that projects the image is moved to a position where the image can be projected onto the arbitrary part.

3. The image projection method according to claim 2, characterized in that the image projection device is moved using an unmanned aerial vehicle.

4. The image projection method according to claim 2, characterized in that the image projection device is moved using indoor equipment.

5. The image projection method according to claim 4, characterized in that the indoor equipment is at least one of the indoor walls, ceilings, and floors, and the image projection device is moved along the indoor equipment.

6. The image projection method according to any one of claims 1 to 5, characterized in that the arbitrary part of the user that serves as the screen is set according to the user's specifications.

7. The image projection method according to any one of claims 1 to 5, characterized in that the arbitrary part of the user that serves as the screen is selected based on the content of the image.

8. The image projection method according to any one of claims 1 to 7, characterized in that the projection method for projecting the image is changed based on the state of the arbitrary part of the user that serves as the screen.

9. The image projection method according to any one of claims 1 to 8, characterized in that the projection method for projecting the image is changed based on the conditions surrounding the arbitrary part of the user that serves as the screen.

10. The image projection method according to claim 9, characterized in that the condition of the area surrounding the aforementioned arbitrary part is the brightness of that area.

11. The image projection method according to any one of claims 1 to 10, characterized in that it recognizes an image projected onto the screen and changes the projection method based on the state of the recognized image.

12. The image projection method according to any one of claims 1 to 11, characterized in that the arbitrary part of the user that serves as the screen is a part of the user's body that is visible to the user.

13. The image projection method according to claim 12, characterized in that the arbitrary part of the user that serves as the screen is the user's hand or arm.

14. The image projection method according to claim 12, characterized in that the arbitrary part of the user that serves as the screen is the user's leg or foot.

15. The arbitrary part of the user that becomes the screen is the fingers or toes of the user. The image projection method according to claim 12, characterized in that it is a fingernail.

16. The image projection method according to any one of claims 1 to 11, characterized in that the arbitrary part of the user that serves as the screen is a part of the user's body that can be seen by the user using a mirror.

17. The image projection method according to claim 16, characterized in that when the user projects the image onto a part visible using a mirror, the left and right sides of the image are reversed.

18. The image projection method according to claim 16, characterized in that the arbitrary part of the user that serves as the screen is the user's face, head, or neck.

19. The image projection method according to claim 12 or 16, characterized in that the arbitrary part of the user that serves as the screen is the torso or buttocks of the user.

20. Identify the location of the user and any part of the user's body, An image projection method characterized by projecting an image transmitted or delivered to the user onto the clothing on the identified arbitrary part of the body, using that clothing as a screen.

21. The image projection method according to claim 20, characterized in that the clothing includes at least one of a garment, gloves, shoes, socks, hat, and mask.

22. The image projection method according to claim 20 or 21, characterized in that the projection method for projecting the image is changed based on the type or condition of clothing worn on any part of the user that serves as the screen.

23. The image projection method according to claim 20 or 21, characterized in that the projection method for projecting the image is changed based on at least one of the color and material of the clothing worn on any part of the user that serves as the screen.

24. Identify the location of the user and any part of the user's body, The identified arbitrary part is used as a screen to project the image transmitted or delivered to the user. An image projection device characterized by comprising a control unit.

25. Identify the location of the user and any part of the user's body, Using the clothing on the identified arbitrary body part as a screen, the image transmitted or delivered to the user is projected. An image projection device characterized by comprising a control unit.

26. The control unit, The image projection device according to claim 25, characterized in that the image projection device that projects the image is moved to a position where the image can be projected onto the arbitrary part.

27. Identify the location of the user and any part of the user's body, An unmanned aerial vehicle characterized by using the identified arbitrary part as a screen to project images transmitted or delivered to the user.

28. Identify the location of the user and any part of the user's body, The clothing on the identified arbitrary body part is used as a screen and transmitted to the user. An unmanned aerial vehicle characterized by projecting distributed images.

29. The unmanned aerial vehicle according to claim 27 or 28, characterized in that the image is moved to a position where it can be projected onto the arbitrary part, and the image is projected.

30. Identify the location of the user and any part of the user's body, The process of projecting the image transmitted or delivered to the user onto the identified arbitrary part as a screen, An image projection program characterized by being executed by an image projection device.

31. Identify the location of the user and any part of the user's body, The process of projecting an image transmitted or delivered to the user onto the clothing on the identified arbitrary body part, using the clothing as a screen, An image projection program characterized by being executed by an image projection device.

32. The image projection program according to claim 30 or 31, characterized in that it causes the image projection device to perform a process of moving the image projection device that projects the image to a position where the image can be projected onto the arbitrary part.

Images