Image projection method

The image projection method projects images onto user-designated body parts using unmanned aerial vehicles or movable projectors, addressing the lack of personal display devices and enabling flexible, private image viewing.

JP7587776B2Active Publication Date: 2024-11-21CONTRACT CO LTD SAKAI YUAI RES INST
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2020113608
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-06-30
Publication Date
2024-11-21
Estimated Expiration
2040-06-30

AI Technical Summary

Technical Problem

Conventional image projection technologies require a display device or a predetermined screen, and are not suitable for personalized or individual image viewing without a display device nearby.

Method used

An image projection method that uses an unmanned aerial vehicle or movable projector to project images onto arbitrary parts of a user's body, such as hands, arms, legs, or clothing, based on user designation and environmental conditions, allowing image projection without a dedicated display device.

Benefits of technology

Enables image viewing on any part of the user's body, even without a display device, providing flexibility and privacy in image projection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007587776000001
    Figure 0007587776000001
  • Figure 0007587776000002
    Figure 0007587776000002
  • Figure 0007587776000003
    Figure 0007587776000003
Patent Text Reader

Abstract

To enable image information to be seen even if a display apparatus such as a portable terminal device is not carried or even if there is no display apparatus such as a display and a screen around.SOLUTION: A user and a position of an optional part of the body of the user are specified, and an image transmitted or distributed to the user is projected with the specified optional part as a screen by using a projector ("drone projector") mounted on a drone. Thus, "palm top screens" 110, 120 are achieved on the palms of the right hand 101 and the left hand 102 of the user, respectively. For example, image information on video call is displayed on the "palm top screen" 110 of the right hand 101, and image information on a screen of a chat is displayed on the "palm top screen" 120 of the left hand 102. A part of the body may be an arm and a wrist, a leg and a foot, or the like. The user does not need a display or a dedicated screen to look at the image.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an image projection method for projecting an image, an image projection device for implementing the image projection method, an unmanned aerial vehicle, and an image projection program. [Background technology]

[0002] In recent years, the opportunities to view images on information terminal devices such as smartphones have become more diverse. A related technology has been a video display system that is equipped with a projection unit on an autonomous robot and projects an image onto a projection surface while detecting the state of the projection surface around the robot, thereby displaying an image that is easily visible to unspecified people (see, for example, Patent Document 1 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-125816 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, if you do not have a display device such as an information terminal device, or if a display device such as a monitor is not installed, you cannot view image information. Also, a projector can only project images onto a predetermined screen.

[0005] Furthermore, the conventional technology described in the above-mentioned Patent Document 1 has a problem in that it is not suitable for viewing image information addressed to an individual.

[0006] In order to solve the problems associated with the conventional technology described above, the present invention aims to provide an image projection method that allows a user to view image information even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby, as well as an image projection device, an unmanned aerial vehicle, and an image projection program that realize the image projection method. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the objective, the image projection method of the present invention is characterized in that it identifies the position of a user and any part of the user's body, and projects an image transmitted or distributed to the user using the identified any part as a screen.

[0008] In the image projection method according to the present invention, in the above-mentioned invention, an image projection device for projecting the image is moved to a position where the image can be projected onto the arbitrary portion.

[0009] In addition, the image projection method according to the present invention is characterized in that, in the above invention, the image projection device is moved by an unmanned aerial vehicle.

[0010] In the image projection method according to the present invention, in the above-mentioned invention, the image projection device is moved using indoor equipment.

[0011] In addition, the image projection method of the present invention is characterized in that, in the above invention, the indoor facility is at least one of an indoor wall, a ceiling, and a floor, and the image projection device is moved along the indoor facility.

[0012] In the image projection method according to the present invention, in the above-mentioned invention, the arbitrary part of the user that becomes the screen is set by designation by the user.

[0013] In the image projection method according to the present invention, in the above invention, the arbitrary part of the user that becomes the screen is selected based on the content of the image.

[0014] Moreover, in the image projection method according to the present invention, in the above-mentioned invention, a projection method for projecting the image is changed based on a state of the arbitrary part of the user that becomes the screen.

[0015] In addition, the image projection method according to the present invention is characterized in that, in the above invention, a projection method for projecting the image is changed based on the surrounding situation of the arbitrary part of the user which serves as the screen.

[0016] In the image projection method according to the present invention, in the above-mentioned invention, the situation around the arbitrary part is the brightness of the surroundings.

[0017] In addition, the image projection method according to the present invention is characterized in that, in the above-mentioned invention, the image projected onto the screen is recognized, and the projection method is changed based on the recognized state of the image.

[0018] In addition, the image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is a part of the user's body that is visible to the user.

[0019] In the image projection method according to the present invention, in the above-mentioned invention, the any part of the user that becomes the screen is a hand or an arm of the user.

[0020] In the image projection method according to the present invention, in the above-mentioned invention, the any part of the user that becomes the screen is a leg or a foot of the user.

[0021] In the image projection method according to the present invention, in the above invention, the any part of the user that serves as the screen is a finger or a toenail of the user.

[0022] In addition, the image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is a part of the user's body that can be viewed by the user using a mirror.

[0023] In the image projection method according to the present invention, in the above-mentioned invention, when the image is projected onto a part visible to the user using a mirror, the image is reversed left and right.

[0024] In the image projection method according to the present invention, in the above invention, the any part of the user that becomes the screen is the face, head or neck of the user.

[0025] In the image projection method according to the present invention, in the above invention, the any part of the user that becomes the screen is the trunk or buttocks of the user.

[0026] In addition, the image projection method of the present invention is characterized in that it identifies the position of a user and any part of the user's body, and projects an image transmitted or delivered to the user using clothing worn in the identified any part as a screen.

[0027] In addition, the image projection method according to the present invention is characterized in that, in the above invention, the clothing includes at least one of clothes, gloves, shoes, socks, a hat, and a mask.

[0028] In addition, the image projection method of the present invention, in the above invention, is characterized in that the projection method for projecting the image is changed based on the type or state of clothing worn on the any part of the user that serves as the screen.

[0029] In addition, the image projection method of the present invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on at least one of the color and material of clothing worn in the any part of the user that serves as the screen.

[0030] In order to solve the above-mentioned problems and achieve the objective, the image projection device of the present invention is characterized by having a control unit that identifies the position of a user and any part of the user's body, and projects an image transmitted or distributed to the user using the identified any part as a screen.

[0031] In addition, the image projection device of the present invention is characterized in that it includes a control unit that identifies the position of a user and any part of the user's body, and projects an image transmitted or distributed to the user using clothing worn in the identified any part as a screen.

[0032] In addition, in the image projection device according to the present invention, the control unit moves the image projection device that projects the image to a position where the image can be projected onto the arbitrary location.

[0033] In order to solve the above-mentioned problems and achieve the objectives, the unmanned aerial vehicle of the present invention is characterized by identifying the position of a user and any part of the user's body, and using the identified any part as a screen to project an image transmitted or distributed to the user.

[0034] In addition, the unmanned aerial vehicle of the present invention is characterized by identifying the position of the user and any part of the user's body, and projecting an image transmitted or distributed to the user using clothing worn in the identified part as a screen.

[0035] In addition, the unmanned aerial vehicle of the present invention, in the above invention, is characterized in that it moves to a position where the image can be projected onto the arbitrary location and projects the image.

[0036] In order to solve the above-mentioned problems and achieve the objective, the image projection program of the present invention is characterized in that it causes an image projection device to execute a process of identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user using the identified any part as a screen.

[0037] In addition, the image projection program of the present invention is characterized in that it causes an image projection device to execute a process of identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user using clothing worn in the identified part as a screen.

[0038] In addition, the image projection program of the present invention is characterized in that, in the above invention, the image projection device executes a process of moving the image projection device, which projects the image, to a position where the image can be projected onto the arbitrary part. Effect of the Invention

[0039] The image projection method, image projection device, unmanned aerial vehicle, and image projection program of the present invention have the effect of enabling a user to view image information even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen in the vicinity. [Brief description of the drawings]

[0040] [Figure 1] This is an explanatory diagram (part 1) showing an overview of an image projection method ("palmtop screen"). [Diagram 2] This is an explanatory diagram (part 2) showing an overview of the image projection method ("drone projector"). [Diagram 3] This is an explanatory diagram (part 3) showing an overview of the image projection method ("palmtop screen"). [Figure 4]This is an explanatory diagram (part 4) showing an overview of the image projection method ("Arm Top Screen"). [Diagram 5] This is an explanatory diagram (part 5) showing an overview of the image projection method ("wrist-top screen"). [Figure 6] FIG. 1 is an explanatory diagram showing an example of the appearance of an image projection device (drone projector). [Figure 7] FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of an image projection device. [Figure 8] FIG. 2 is a block diagram showing an example of a functional configuration of the image projection device. [Figure 9] 11 is a flowchart showing an example of a processing procedure of the image projection device. [Figure 10] FIG. 11 is an explanatory diagram showing an example of an image projection device (a movable projector) according to another embodiment of the present invention and an environment in which the image projection device moves. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0041] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of an image projection method, an image projection device, an unmanned aerial vehicle, and an image projection program for implementing the image projection method according to the present invention will be described in detail below with reference to the accompanying drawings.

[0042] (Overview of image projection method) 1 to 5 are explanatory diagrams showing an outline of an image projection method. In FIG. 1, image information 110 related to a video call is projected onto a user's right hand 101. Image information 120 related to a chat screen is projected onto a user's left hand 102. In addition, image information desired by the user can be projected onto the right hand 101 and the left hand 102. For example, image information 110 related to a video call with a different person may be projected onto both the right hand 101 and the left hand 102. In this way, an image is projected onto the palm of at least one of the user's hands. The inventor named the use of the palm as a screen "PALM TOP SCREEN".

[0043] Sound accompanying image information, such as the sound from the other party in a video call when an image related to a video call is projected, can be output from earphones worn by the user or a speaker installed in the vicinity of the user. The speaker may be mounted on the image projection device 200 shown in FIG. 2 (speaker 707 shown in FIG. 7 described later). The user's voice can be input (collected) from earphones worn by the user or a microphone installed in the vicinity of the user. The microphone may be mounted on the image projection device 200 (microphone 706 shown in FIG. 7 described later).

[0044] FIG. 2 shows a state where the image projection device 200 projects image information 110 related to a video call onto the palm of the user 201. As shown in FIG. 2, the image projection device 200 projects the image information 110 onto the palm, which is an arbitrary part of the body of the user 201, so that the palm, which is an arbitrary part of the body of the user 201, can be used as a screen. The image projection device 200 is equipped with a projector on a drone (unmanned aerial vehicle), which stops in a predetermined space while flying, and projects an image from there onto the palm, which is an arbitrary part of the body of the user 201. The inventor named this image projection device 200 "drone projector" (abbreviated as "DRONE PROJECTOR").

[0045] By using the palm as a screen, a dedicated display device for viewing image information is not required. By changing the direction of the palm, it is possible to prevent other people nearby from peeking at the image information. Also, by changing the direction of the palm, it is possible to share and view the image information with other people next to or across from you.

[0046] As shown in FIG. 1, by using both hands, a user can simultaneously view at least two different screens. In order to display two different image information, two or more projectors may be mounted on one drone, or multiple drone projectors may be used to project from each of them. Also, as shown in FIG. 2, by bringing both hands close to each other or touching each other, one image can be enlarged and displayed across both hands.

[0047] As can be seen from Figs. 1 and 2, these pieces of image information 110 and 120 are projected images projected from the image projection device 200 onto the open palms of the hands. In order to project the image information 110 and 120 onto the palms of the user 201 in this way, the image projection device 200 first identifies the user 201 onto whom the image information is to be projected. Then, the position of the palm of the identified user 201 is identified, and the image transmitted to the user 201 is projected onto the identified palm as a screen. This allows the user 201 to view the image information 110 and 120 projected onto his or her palm.

[0048] As shown in FIG. 3, the orientation of the image information 110 may be determined based on the relationship between the user's line of sight (the position of both eyes) and the position of the palm 101. Therefore, regardless of the direction of the fingertips, the angle at which the user can easily see may be estimated from the positions of the left and right eyes of the user 201, and the orientation of the image information may be determined. In FIG. 3, it can be seen that the orientation at which the image 110 is projected on the palm is different from that in FIG. 1. The orientation of the image 110 is changed depending on the direction in which the user 201 spreads his / her right hand 101. Therefore, even if the user 201 changes the angle of his / her hand, the orientation at which the image is projected is always constant with respect to the line of sight of the user 201, so that the visibility of the image information 110 can be improved.

[0049] The direction in which the image information is projected may be changed (for example, by inverting the image information upside down) by instructions from the user 201 using voice (for example, "Make it visible to the person opposite") or gestures. This allows the image information to be easily viewed not only by the user 201 but also by other people next to or opposite the user.

[0050] If the angle of the palm is changed or the position of the palm moves, image projection device 200 recognizes the change and follows the change in the angle and position of the palm so that it can continue to project image information onto the palm. Therefore, until an instruction to end the projection is given by user 201, image information can be continuously projected onto the palm in the same manner as when it is displayed on a display device, for example.

[0051] The dimensions of the image information may be determined based on the size, shape, etc. of the palm of user 201. The dimensions of the image information when projected onto the palm may be determined in advance for each user 201. This ensures that image information of the same dimensions is always displayed on the palm, reducing the sense of discomfort felt by user 201 each time he or she views the image information.

[0052] The dimensions of the image information may be changed by an instruction from the user 201. The instruction from the user 201 to change the dimensions may be a voice (e.g., saying "make it bigger" or "make it smaller") or a gesture (e.g., pointing to a desired size with a finger). The voice may be collected by a microphone 706 mounted on the image projection device 200 or the like, and the instruction from the user 201 may be determined by voice recognition or the like. The gesture may be photographed by a camera mounted on the image projection device 200 or the like (camera 603 shown in Figs. 6 and 7 described later), and the instruction from the user 201 may be determined by image recognition or the like.

[0053] The notification of image reception is made by a chime, an alarm, a voice ("You have received a message from Mr. / Ms. XX"), or the like. The voice can be output to a speaker 707 shown in FIG. 7 described later or to the user's earphones. The notification of image reception may also be made by emitting light or vibrating belongings. Furthermore, the notification may be made by the drone projector 200 flying in front of the user 201.

[0054] When notified of image reception, user 201 issues a command to start projection. The command to start projection can be specifically given, for example, by speaking ("display it") or by a specified gesture. Next, user 201 issues a command for the projection position. The command for the projection position can be specifically given, for example, by speaking ("back of left hand") or by a gesture (opening the palm of the hand with the palm facing up. Making a gesture as if looking at a watch. Pointing to the desired position with a finger). The command to start projection and the command for the projection position may be a series of actions. (For example, speaking "display it on the thigh of the left leg." Also, pointing to the left arm with the index finger of the right hand.) In this way, the intention of user 201 can be confirmed.

[0055] FIG. 4 shows an example of projection onto a body part of the user 201 other than the palm. As shown in FIG. 4, depending on the display form of the image information to be displayed, for example, the image information may be displayed continuously from near the wrist of the left hand along the arm to the shoulder. The inventor has named this use of the arm as a screen as an "arm top screen." In FIG. 4, the arm top screen 400 displays map information as an example of image information. In this way, a relatively large image can be displayed by utilizing the length of the arm, and a navigation function that is easier to understand can be realized. In addition to map information, the arm top screen 400 can project a vertically long image, for example, a long chat screen (with many chats) by raising the arm.

[0056] (An example of a body part onto which image information is projected) The body part onto which the image information is projected may be any body part that is visible to the user 201. The body part onto which the image information is projected may be the hand or arm of the user 201. However, the hand is not limited to the palm. It may not be limited to the palm, and specifically may be, for example, the back of the hand (not shown). The inventor has named the use of the back of the hand, other than the palm, as a screen a "HAND TOP SCREEN."

[0057] The body part onto which the image information is projected may be, for example, a finger. The inventor has named the use of the finger as a screen as a "FINGER TOP SCREEN." The part of the finger onto which the image information is projected may be the palm side, the back side of the hand, or both, or it may be a part between the palm side and the back side of the hand. Also, text information such as a message of, for example, one to three lines, may be displayed on the finger along the longitudinal direction of the finger. Separate text information may be displayed on each finger, or continuous text information may be displayed on each finger.

[0058] An example of a "finger top screen" may include a "nail top screen" using a fingernail as a screen. In this way, by using a nail, which is harder and shinier than skin, as a screen, an image can be projected more clearly. By determining in advance which fingernail the image information is to be projected onto depending on the destination, the destination of the image information can be instantly and intuitively understood (e.g., the nail on the thumb of the right hand is for person A, and the nail on the middle finger of the left hand is for person B). Also, based on the content of the image information, it may be determined in advance which fingernail the image information is to be projected onto. For example, an emergency message may be projected onto the nail of the thumb of the right hand.

[0059] Another example of the user's hand or arm, which is a body part onto which image information is projected, may be the wrist as shown in FIG. 5. The inventor has named the use of the wrist as a screen "LIST TOP SCREEN". As shown in FIG. 5, the wrist top screen 500 projects image information at approximately the same position as the display position of a wristwatch. Therefore, the user can view the wrist top screen 500 with a similar sensation to viewing the display of a wristwatch. The wrist top screen 500 may be the wrist on the back side of the hand as shown in FIG. 5, or the wrist on the palm side of the opposite hand, or may be the wrist part between the back side and the palm side of the hand.

[0060] The body part onto which the image information is projected may be the legs or feet of the user 201. For example, when the user 201 is sitting, the projected image can be easily viewed by using the legs or feet as a screen. Specifically, the body part may be a "lap top screen" (the knees, or the legs between the knees and the hip joints when sitting on a chair, etc.), a "leg top screen" (the entire legs, such as the calves when legs are crossed), or a "foot top screen" (the instep, sole, toes, etc.). The ankle is included in either the "leg top screen" or the "foot top screen".

[0061] The legs or feet have a relatively large screen area compared to the hands or arms, allowing a larger image to be projected, and by using them as a screen together with the hands or arms, more image information can be seen.

[0062] Similarly to fingernails, an example of a "foot top screen" may include a "nail top screen" in which the toenail is used as a screen.

[0063] In addition, the body parts onto which the image information is projected may be body parts that are normally difficult to see but can be seen by using a mirror or the like (for example, the user's own face (a "FACE TOP SCREEN", particularly the cheeks), head (a "HEAD TOP SCREEN", particularly the forehead or areas where hair grows), neck (a "NECK TOP SCREEN"), or shoulders (a "SHOULDER TOP SCREEN"). All of these names were coined by the inventor.

[0064] Furthermore, the body parts onto which the image information is projected may be the trunk, such as the back ("BACK TOP SCREEN") or abdomen ("ABD TOP SCREEN"), or the buttocks ("HIP TOP SCREEN"). These names were also given by the inventor. When a mirror or the like is used, image information that has been mirror-inverted (reversing the left and right sides of the image) can be projected. The nose and ears are included in the "face top screen".

[0065] In particular, by using a mirror to project an image onto the user's 201 own face ("face top screen"), neck ("neck top screen"), shoulders ("shoulder top screen"), or head ("head top screen"), the image information can be checked, for example, while applying makeup, washing or getting a haircut.

[0066] Also, in the case of the trunk or buttocks, the user 201 can check the image information while looking at his or her entire body in a mirror.

[0067] As applications of these, the image information can be images of makeup, clothing, accessories (such as glasses), accessories (such as necklaces), and tattoos. These image information can be directly projected onto the body parts of the user 201, allowing them to enjoy virtual makeup and trying on clothes. It can also be used during surgery, for example, to display the location of an affected area at the corresponding position on a body part. In addition, ideal body lines can be projected directly onto the body to set a goal for dieting.

[0068] In this way, by using each part of the user's body as a screen, a dedicated device such as a screen is not required to view the image. In addition, the user does not need to carry an information terminal device with a display screen (the user can view the image "empty-handed").

[0069] The part of the body onto which the image information is to be projected is selected by the user's instruction. The user's instruction may be voice (e.g., saying "display it on the back of my right hand" or "my left wrist") or gesture (e.g., pointing to the desired location for projection). Also, the part of the body onto which the image information is to be projected may be selected depending on the type of image information. For example, highly confidential information may be displayed on the palm of the hand, and the image content may be prevented from being seen by people nearby by adjusting the orientation and angle of the palm or the distance from the face.

[0070] Also, the part of the body may be selected according to the user's posture. When the user is sitting on a chair, the image may be projected onto the knees or legs. When the user is holding an object or performing a task with one hand, the image may be projected onto the other hand or another body part.

[0071] The image information may be projected directly onto the skin of a body part of the user, or, if the user is wearing clothing, onto the clothing. The projection method (color, luminosity, etc.) can be changed between projecting onto the skin and projecting onto clothing. It can also be changed depending on the type of clothing (material, color, etc.). These differences can be determined by analyzing images captured by a camera mounted on the image projection device.

[0072] (An example of the external appearance of the image projection device 200) Next, an example of the appearance of an image projection device according to an embodiment of the present invention will be described. Fig. 6 is an explanatory diagram showing an example of the appearance of an image projection device. As shown in Fig. 6, the image projection device (drone projector) 200 includes a projector (projection unit) 601, a drone (unmanned aerial vehicle) 602, a camera 603, and a human presence sensor 604. That is, the projector 601, the camera 603, and the human presence sensor 604 are mounted on the drone 602.

[0073] The projector 601 includes a projector light source, an optical system, a projection lens, and the like (all of which are omitted from the drawings). The projector 601 guides light emitted from the projector light source to a predetermined path by the optical system, and irradiates the light to the outside of the projector 601 via the projection lens 601a, thereby projecting an image at the location where the light is irradiated. The optical system includes an integrator lens that increases the uniformity of the illuminance of the light emitted from the projector light source, a polarization conversion element that converts (polarizes) the light emitted from the non-polarized light source to a predetermined polarization direction, a dichroic mirror that separates the light from the projector light into the three primary colors of R, G, and B, a liquid crystal panel that displays an image corresponding to each color of light of R, G, and B, and a dichroic prism that combines the images of each color displayed by each liquid crystal panel (all of which are omitted from the drawings).

[0074] As the projector 601, for example, a laser projector that uses a laser as the projector light source can be used. By using a laser projector, it is possible to reduce the size of the projector 601. Specifically, since a laser projector can suppress heat generation to a lower level than a mercury lamp projector that uses a mercury lamp as the projector light source, it is possible to reduce the size and weight by eliminating mechanisms such as a cooling fan.

[0075] In addition, by using a laser projector, it is possible to start up and start projecting an image quickly, and by using a laser projector, it is possible to achieve high brightness of the projected image while reducing power consumption compared to a mercury lamp projector.

[0076] Mercury lamp projectors are recommended to be used with the projection (optical axis) direction horizontal, limiting the freedom of projection direction, whereas laser projectors can be used with the optical axis tilted from the horizontal. This allows laser projectors to have a high degree of freedom in the projection direction, and they can project images not only onto walls but also onto the ground and floor.

[0077] The drone 602 moves the projector 601. By moving the projector 601 using the drone 602, which is called an unmanned aerial vehicle, the projection location of the image by the projector 601 can be moved. Specifically, for example, a quadcopter equipped with four propellers 605 can be adopted as the drone 602. The drone 602 is not limited to a quadcopter, and various types of multicopters such as a hexacopter equipped with six propellers and an octocopter equipped with eight propellers can be adopted as the drone 602.

[0078] The projector 601 is fixed to the drone 602, and moves with the movement (flight) of the drone 602. The projector 601 may be connected to the drone 602 in a state in which its attitude can be adjusted. Specifically, for example, the projector 601 can be connected to the bottom part of the drone 602 via a universal joint such as a ball joint. By connecting the projector 601 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the projector 601 can be ensured.

[0079] In this case, the image projection device 200 may include a drive mechanism that changes the attitude of the projector 601 with respect to the drone 602 in order to adjust the attitude of the projector 601 with respect to the drone 602 without human intervention. The drive mechanism can be configured with, for example, a motor, a gear train, or the like. By making the attitude of the projector 601 with respect to the drone 602 adjustable, it is possible to project an image at an optimal angle according to the location where the image is to be projected.

[0080] The camera 603 captures an image of the user 201 shown in Fig. 2 and also captures an image projected by the projector 601. Specifically, the camera 603 can be realized by, for example, a general-purpose digital camera. The camera 603 is fixed to the drone 602 with, for example, a lens 603a facing in the same direction as the projection direction of the image by the projector 601.

[0081] The camera 603 may be connected to the drone 602 in a state in which the direction in which the lens is directed is adjustable with respect to the projection direction of the image by the projector 601. In FIG. 6, the camera 603 can be rotated around an axis that connects the camera 603 to the drone 602. The camera 603 may be connected to the bottom of the drone 602 via a universal joint such as a ball joint. By connecting the camera 603 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the camera 603 can be ensured.

[0082] In this case, the image projection device 200 may include a drive mechanism that changes the attitude of the camera 603 with respect to the drone 602 in order to adjust the direction in which the lens 603a is pointed without human intervention. The drive mechanism can be configured, for example, with a motor, a gear train, or the like. By making it possible to adjust the direction in which the lens 603a is pointed with respect to the projection direction of the image by the projector 601, it is possible to use one camera 603 to capture an image projected by the projector 601 and to capture an image around the image projection device 200.

[0083] In the image projection device 200, a drive mechanism that adjusts the attitude of the projector 601 relative to the drone 602 and a drive mechanism that adjusts the attitude of the camera 603 relative to the drone 602 may operate independently. This makes it possible to project an image using the projector 601 while capturing the projected image using the camera 603, or to adjust the attitude of the camera 603 to capture a direction different from the projection direction of the image.

[0084] The camera 603 is not limited to a general-purpose digital camera, and may be realized by, for example, a night vision camera that captures images in dark places by amplifying the sensitivity to light, or an infrared camera that is sensitive to infrared rays. By installing such a camera 603, it is possible to clearly capture images of the user and any part of the user, and images projected by the projector 601, even at night, without using a light source for auxiliary imaging. This makes it possible to suppress increases in the weight and power consumption of the image projection device 600.

[0085] The human presence sensor 604 detects a user present within a predetermined range from the image projection device 200. The user is a target for visualizing the image projected by the image projection device 200. Specifically, the human presence sensor 604 can be realized by, for example, an infrared sensor. The infrared sensor detects a temperature rise (temperature change) caused by a light receiving element absorbing infrared rays emitted by a detected object such as a user using a temperature sensor, and outputs a predetermined electrical signal. By using the infrared sensor, it is possible to detect the presence or absence of a viewer and the movement of the viewer.

[0086] The user detection range of the human presence sensor 604 realized by an infrared sensor can be adjusted, for example, by adjusting the sensitivity of the infrared sensor, the number and arrangement of the sensor elements (pixels), the amplification factor of the current sensed by the sensor elements (pixels), etc. The human presence sensor 604 is not limited to being realized by an infrared sensor, and may be, for example, a sensor that detects the user 201 using ultrasonic waves or visible light, or a sensor that detects the user 201 by a method that combines infrared rays and ultrasonic waves.

[0087] In this way, the image projection device 200 is a drone projector that can move its position in space by flying indoors and outdoors. This drone projector may be a drone projector for personal use, or may be a public drone projector shared by multiple users.

[0088] (Hardware configuration of image projection device 200) Next, the hardware configuration of the image projection device 200 will be described. Fig. 7 is an explanatory diagram showing the hardware configuration of the image projection device 200. As shown in Fig. 7, the hardware of the image projection device 200 is composed of a battery 701, a control circuit 702, a communication I / F 703, a GPS receiver 704, a motor 705, a projector 601, a camera 603, a motion sensor 604, a microphone 706, a speaker 707, etc. The respective units 601, 603, 604, 701 to 707 included in the image projection device 200 are connected by a bus 700.

[0089] The battery 701 supplies power required for the operation of each unit included in the image projection device 200. The battery 701 can be realized by, for example, a secondary battery (rechargeable battery, storage battery) such as a lithium battery. The battery 701 realized by a secondary battery may be detachable from the drone 602.

[0090] Furthermore, the image projection device 200 may include a charging contact for charging the battery 701. The charging contact may have, for example, an exposed terminal shape or a connector shape. Alternatively, instead of or in addition to the charging contact for charging the battery 701, the image projection device 200 may include a power receiving coil for wireless power transfer (contactless power transmission).

[0091] Wireless power supply is a technology for receiving power from the battery 701 without going through a charging contact, and is also called non-contact power supply or wireless power supply. The power receiving coil is provided inside the exterior surface of the drone 602. This makes it possible to avoid deterioration or failure of the image projection device 200 due to water droplets from rain or dew. The battery 701 may be realized by a primary battery that only discharges DC power.

[0092] The control circuit 702 is configured with a CPU, a memory, etc., and drives and controls each unit of the image projection device 200. The CPU executes a program stored in the memory, thereby taking charge of controlling the entire image projection device 200. The memory stores the program executed by the CPU. The memory also stores various types of information including, for example, image information related to the image to be projected.

[0093] Specifically, the memory can be realized by, for example, an IC memory or an SSD (Solid State Drive). The memory may also be a memory card that is detachable from the image projection device 200 via a card slot provided in the image projection device 200. The memory card can realize its function by, for example, an IC card such as an SD (Secure Digital) memory card. The memory may also realize its function by, for example, an external hard disk or USB memory.

[0094] Specifically, the control circuit 702 includes, for example, a flight controller and an ESC (Electronic Speed ​​Controller). The control circuit 702 may further include a BEC (Battery Elimination Circuit) and a UBEC (Universal BEC). In addition, when the battery 701 is realized by a secondary battery, the control circuit 702 may include a charging circuit that charges (stores) the battery 701.

[0095] The flight controller performs calculations related to the rotation control of the motor 705 and outputs a control signal. The ESC controls the rotation of the motor 705 based on the control signal output from the flight controller. While the image projection device 200 is flying, the flight controller detects the inclination of the image projection device 200 and performs calculations repeatedly, and recursively outputs a control signal for the motor 705.

[0096] The flight controller outputs a control signal to the ESC to control the direction and speed of rotation of the propeller (propeller motor 705). Specifically, for example, the control signal is output to control adjacent propellers to rotate in opposite directions, thereby preventing the image projection device 200 from rotating. Also, for example, the image projection device 200 is caused to move forward by controlling the propeller at the front in the traveling direction to rotate slower than the propeller at the rear in the traveling direction. Also, for example, the image projection device 200 is caused to turn right by controlling the propeller at the right in the traveling direction to rotate slower than the propeller at the left in the traveling direction.

[0097] Specifically, the control circuit 702 includes, for example, a GPU (Graphics Processing Unit) that is specialized for image processing related to images projected by the projector 601. By including a GPU, it is possible to project fast-moving videos and the like with high image quality.

[0098] The communication I / F 703 is an interface that connects the image projection device 200 and the network N through a communication line, and manages the interface between the network N and the inside of the image projection device 200, and controls the input of data from and the output of data to an external device connected via the network N. The network N is realized by, for example, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or the like.

[0099] The communication I / F 703 is, for example, a wireless interface based on Wi-Fi (registered trademark). The communication I / F 703 may also be an interface for wireless communication such as a mobile phone line (e.g., LTE (Long Term Evolution) or PHS (Personal Handy-phone System)).

[0100] The control circuit 702 can acquire various kinds of information including image information related to an image to be projected from an external device by communicating with the external device via the communication I / F 703. Furthermore, every time the control circuit 702 acquires various kinds of information from the external device, the control circuit 702 may store the acquired information in memory or update the contents of the memory based on the acquired information.

[0101] The GPS receiver 704 identifies the current position of the image projection device 200. Specifically, the GPS receiver 704 includes, for example, a GPS antenna, an RF (Radio Frequency) unit, and a baseband unit. The GPS antenna receives radio waves broadcast by GPS satellites. The RF unit demodulates the pre-modulation signal received by the GPS antenna into a baseband signal. The baseband unit calculates the current position of the image projection device 200 based on the baseband signal demodulated by the RF unit. The GPS receiver 704 may further include a filter that removes unnecessary components and an amplifier such as an LNA (Low Noise Amplifier) ​​or a PA (Power Amplifier).

[0102] The current position of the image projection device 200 can be determined by positioning based on radio waves transmitted from multiple GPS satellites. The baseband unit performs positioning by calculating the distances to each of the four GPS satellites and calculating the position where the distances intersect. Instead of GPS, which determines the geometric position of the GPS satellite and the image projection device 200 based on radio waves received from the GPS satellite, the current position of the image projection device 200 may be determined using a satellite positioning system such as Michibiki, GLONASS, or Galileo.

[0103] Motor 705 is controlled by control circuit 702, and rotates propeller 605 by rotating. Specifically, motor 705 may be, for example, a brushless motor in which the rotor is a permanent magnet and the stator is configured by a coil. The same number of motors 705 as the number of propellers 605 may be provided. This allows each propeller 605 to rotate independently, and allows image projection device 200 to move forward, backward, and turn left and right.

[0104] When a driving mechanism for adjusting the attitude of the projector 601 or the camera 603 is provided, the control circuit 702 also controls the operation of the motor 705 provided in each of these driving mechanisms. This allows the image projection device 200 to adjust the attitude of the projector 601 and the camera 603 independently (individually) while moving.

[0105] As described above, the projector 601 guides the light emitted from the projector light source to a predetermined path by the optical system and irradiates the light to the outside of the projector 601 via the projection lens 601a, thereby projecting an image at the location where the light is irradiated. The projector 601 may adjust the image quality of the projected image by adjusting the intensity of the light emitted from the projector light source according to the distance from the position where the image is projected. The distance between the projector 601 and the position where the image is projected can be specified by using, for example, a distance sensor. The distance sensor can be, for example, various known sensors such as a laser distance sensor, an ultrasonic sensor, or an infrared sensor.

[0106] The camera 603 includes an imaging element, and generates image information (photographed data) by converting light received by the imaging element through a photographing lens into an electrical signal. The generated image information is output to the control circuit 702. The camera 603 may be one that captures still images or one that captures moving images. Moving images include still images captured at a predetermined time interval and then played back continuously. The image information may be compressed according to a predetermined standard for a compression method for moving image and audio data (e.g., MPEG (Moving Picture Experts Group)).

[0107] The human sensor 604 outputs an electrical signal corresponding to a temperature change caused by the light receiving element absorbing infrared rays to the control circuit 702. Specifically, the human sensor 604 converts a current signal corresponding to the temperature change into a voltage signal, for example, and amplifies it, and when the amplified voltage signal exceeds a predetermined threshold, outputs a predetermined electrical signal to the control circuit 702. The control circuit 702 detects the user 201 when it receives an input of the predetermined electrical signal output from the human sensor 604.

[0108] The microphone 706 collects sounds around the image projection device 200. The microphone 706 converts sounds input as analog data into electrical signals. Specifically, the microphone 706 performs analog / digital conversion on the analog sound signal input as analog data, and generates sound data in digital format.

[0109] The speaker 707 generates sound by vibrating a diaphragm with an electric signal, which is an audio signal. The speaker 707 may be an output terminal that outputs an audio signal, and an external speaker may be connected to the output terminal to generate sound.

[0110] Although not shown in the drawings, the image projection device 200 may also include an LED lamp that indicates the state of the image projection device 200, and an input / output device such as a key or button that inputs instructions to the image projection device 200. The input / output device may be realized by a connection terminal to which another information processing device can be connected.

[0111] Furthermore, the image projection device 200 may include a memory card I / F, which is an interface connected to the image projection device 200 via a card slot. The memory card I / F manages the interface with the memory card and controls the input of data from the memory card and the output of data to the memory card. This allows the image to be projected by the image projection device 200 to be stored in the memory card, and the image to be projected by the image projection device 200 to be switched simply by replacing the memory card.

[0112] (An example of a functional configuration of the image projection device 200) Next, an example of the functional configuration of the image projection device 200 will be described. FIG. 8 is a block diagram showing an example of the functional configuration of the image projection device 200. As shown in FIG. 8, the functions of the image projection device 200 according to the embodiment of the present invention are realized by a user instruction receiving unit 801, a projection target user identifying unit 802, a body part information acquiring unit 803, a projection image information acquiring unit 804, a body part identifying unit 805, a projection position / projection dimension determining unit 806, a warning output unit 807, a movement position / projection angle determining unit 808, a movement / projection angle control unit 809, an image information projecting unit 810, a projection image capturing unit 811, and an instruction output unit 812. Therefore, the functions of the control unit of the image projection device 200 can be realized by these components 801 to 812.

[0113] The user instruction accepting unit 801 accepts an instruction to project image information for the user 201. Then, the accepted projection instruction is output to the projection target user identifying unit 802. Specifically, the user instruction accepting unit 801 can realize its functions by, for example, the camera 603 and microphone 706 shown in FIG. 6 and FIG. 7, the control circuit 702 and the communication I / F 703 shown in FIG. 7, and the like. The user instruction accepting unit 801 can accept an instruction to end projection. The accepted instruction to end projection is output to the image information projection unit 810.

[0114] Furthermore, the user instruction receiving unit 801 can receive various operation instructions for the projected image information. The received various instructions can be output (transmitted) to the outside from the instruction output unit 812. Note that all or part of the various instructions from the user may be directly transmitted to the outside without going through the image projection device 200.

[0115] The projection target user identification unit 802 identifies a projection target user who has received a projection instruction by the user instruction receiving unit 801. Specifically, the projection target user identification unit 802 can realize its function by, for example, the camera 603, the microphone 706, the control circuit 702, and the communication I / F 703 shown in Fig. 7. The projection target user identification unit 802 identifies the projection target user as follows.

[0116] In the case of a user-dedicated image projection device 200, user information (ID information transmitted by the user or information identified from the user's physical characteristics) is stored in advance, and the user's current location is identified based on that information. The user's location is grasped at regular time intervals. When the user moves, the location is captured.

[0117] In the case of a shared image projection device, user information is received, and the corresponding user 201 is searched for based on the information. The search for user 201 may be performed based on position information of user 201 calculated based on a user ID signal transmitted by user 201, for example. The search for user 201 may also be performed by identifying the corresponding user 201 by analyzing an image captured by camera 603 based on information related to the morphological characteristics of user 201. When the current position of user 201 is searched for, the current position of the user 201 is identified and grasped at regular time intervals. Then, when user 201 moves, the position is captured.

[0118] The projection target user identifying section 802 outputs information about the identified projection target user 201, specifically, position information of the user, to the body part identifying section 805.

[0119] Body part information acquisition unit 803 acquires information about a body part that serves as a screen onto which image information is projected. Specifically, the body part information acquisition unit 803 can realize its functions using, for example, camera 603, microphone 706, and communication I / F 703 shown in FIG. 7. When a body part is designated by user 201, body part information acquisition unit 803 acquires the designated information using camera 603, microphone 706, communication I / F 703, etc. Body part information acquisition unit 803 outputs the acquired body part information to body part identification unit 805.

[0120] The projection image information acquisition unit 804 acquires image information to be projected. Specifically, the projection image information acquisition unit 804 can realize its function by, for example, the communication I / F 703 shown in FIG. 7. The projection image information may be a still image or a video. The acquired image information also includes information on the content (profile) of the image. Specifically, the type of image (e.g., chat, video call, etc.), the resolution of the image, the amount of data, etc. The projection image information acquisition unit 804 outputs the acquired image information to the image information projection unit 810. In addition, the projection image information acquisition unit 804 outputs information on the content of the image from the acquired image information to the body part identification unit 805 and the projection position / projection dimension determination unit 806.

[0121] The body part identification unit 805 identifies the information on the projection target user identified by the projection target user identification unit 802, the information on the body part acquired by the body part information acquisition unit 803, and the body part that will be the screen on which the image information is projected. Furthermore, the body part may be identified based on information on the content of the image acquired by the projection image information acquisition unit 804. For example, if the image is relatively large, even if the user 201 designates the palm, it can be changed to the arm. In this case, it is also possible to notify (project) the user that the designated body part will be changed. Specifically, the body part identification unit 805 can realize its function by, for example, the camera 603, the human sensor 604, and the control circuit 702 shown in FIG. 7, shown in FIG. 6 and FIG. 7.

[0122] Specifically, the body part identification unit 805 identifies the body part as follows. When the body part is the palm, first, when an instruction to project image information is given, the position of the palm of the user, whose position is known, is identified. The position is identified by analyzing an image captured by the camera 603 mounted on the image projection device 200. The position may also be identified using a human presence sensor 604 such as an infrared sensor as an alternative or supplement to the camera. Specifically, the direction and posture of the user are identified from the positions of each part of the user's body, such as the head, shoulders, and arms, and the position of the user's palm is inferred.

[0123] The position of the palm is then ascertained based on the shape of the palm. Furthermore, the palm may be authenticated as belonging to the user based on physical characteristics of the palm (such as finger length, fingerprints, palm lines, and veins).

[0124] In this way, the body part identifying unit 805 identifies the body part (palm). The other body parts can be identified based on their respective features. The body part identifying unit 805 outputs information about the identified body parts to the projection position / projection dimension determining unit 806.

[0125] The projection position / projection dimension determination unit 806 determines the projection position at which the image information is projected and the dimensions of the projected image based on the body part identified by the body part identification unit 805. In addition, the projection position at which the image information is projected and the dimensions of the projected image may be determined based on the contents by referring to the contents of the image information acquired by the projection image information acquisition unit 804. Specifically, the function of the projection position / projection dimension determination unit 806 can be realized by, for example, the control circuit 702 shown in FIG.

[0126] Specifically, the projection position / projection dimension determination unit 806 may determine the projection position and projection direction from the direction of the fingers, the angle of the wrist, and the like, based on information about the position of the palm of the user 201 that is placed on the body part identified by the body part identification unit 805. Also, the projection position / projection dimension determination unit 806 may determine the size of the palm from information about the palm of the user 201 that is placed on the body part identified by the body part identification unit 805, and determine the dimensions of the image information to be projected so that the image fits on the palm.

[0127] Furthermore, the projection position / projection dimension determination unit 806 may change the projection method for projecting the image based on the state of the body part identified by the body part identification unit 805. Specifically, the state of the body part is, for example, wearing gloves. The projection position / projection dimension determination unit 806 outputs information related to the determined projection position, projection dimension, etc. to the movement position / projection angle determination unit.

[0128] Furthermore, if the projection position / projection dimension determination unit 806 determines that projection onto the palm is not possible based on the direction of the fingers, the angle of the wrist, etc., it outputs to the warning output unit 807 information to the effect that projection is not possible, and also information urging the user to change the position of the palm.

[0129] When the projection position / projection dimension determination unit 806 determines the projection position and projection dimension, if projection is not possible on the body part identified by the body part identification unit 805, the warning output unit 807 outputs a warning to that effect and to prompt the user to move the position of the user or the position of the body part. Specifically, the function of the warning output unit 807 can be realized by, for example, the communication I / F 703 and the speaker 707 shown in FIG.

[0130] The movement position / projection angle determination unit 808 determines at least one of the movement position of the image projection device 200 and the projection angle of the image projection device 200 based on the projection position and projection dimension determined by the projection position / projection dimension determination unit 806. Specifically, the function of the movement position / projection angle determination unit 808 can be realized by, for example, the control circuit 702 shown in Fig. 7. Specifically, the movement position / projection angle determination unit 808 calculates latitude and longitude information of the position to which the image projection device 200 is moved and the projection angle of the projector 601, and outputs the calculation result to the movement / projection angle control unit 809.

[0131] The movement and projection angle control unit 809 controls the motor 705 to move the image projection device 200 based on the movement position of the image projection device 200 determined by the movement position and projection angle determination unit 808. Also, the movement and projection angle control unit 809 adjusts the projection angle of the image projection device 200 based on the movement position of the image projection device 200 determined by the movement position and projection angle determination unit 808. Specifically, the movement and projection angle control unit 809 can realize its functions by, for example, the control circuit 702, the GPS receiver 704, the motor 705, and the like shown in FIG.

[0132] The image information projection unit 810 projects the image information acquired by the projection image information acquisition unit 804 onto the identified body part as a screen. The projection of the image information may be stopped in response to an instruction to end the projection received by the user instruction reception unit 801. Specifically, the image information projection unit 810 can be realized by, for example, the projector 601 shown in Figs. 6 and 7, the control circuit 702 shown in Fig. 7, or the like.

[0133] The projection image photographing unit 811 photographs an image projected using an arbitrary body part as a screen, or photographs or acquires the surrounding circumstances of the image. Specifically, the projection image photographing unit 811 can realize its function by, for example, the camera 603 and the motion sensor 604 shown in Figs. 6 and 7. The projection image photographing unit 811 outputs information on the surrounding circumstances of the photographed image or the acquired image to the projection position and projection dimension determination unit 806.

[0134] The projection position / projection dimension determination unit 806 may change the projection method for projecting the image based on the acquired surrounding conditions of the arbitrary part, and output information related to the changed projection method to the image information projection unit 810. The surrounding conditions of the arbitrary part may specifically be the brightness of the surroundings. When the surroundings are relatively bright, the illuminance of the projected image may be increased. On the other hand, when the surroundings are relatively dark, such as at night, the illuminance of the projected image may be decreased.

[0135] The projection position / projection dimension determination unit 806 may recognize (analyze) the image captured by the projection image capturing unit 811, and change the projection method based on the recognized image condition. Specifically, if the image quality of the projected image is degraded or the user 201 has difficulty viewing the image, the projection position, projection dimensions, etc. may be changed to improve visibility. Then, information related to the changed projection method may be output to the image information projection unit 810.

[0136] The instruction output unit 812 outputs information related to an instruction from the user 201 with respect to the projected image information, which is received by the user instruction receiving unit 801. Specifically, the function of the instruction output unit 812 can be realized by, for example, the communication I / F 703 shown in Fig. 7. Also, the information related to the instruction may be transmitted to each component via the bus 700.

[0137] (An example of a processing procedure of the image projection device 200) Next, a description will be given of an example of a processing procedure of the image projection device 200. Fig. 9 is a flowchart showing an example of a processing procedure of the image projection device 200. In the flowchart of Fig. 9, the image projection device 200 first identifies a current position of a projection target user onto whom image information is to be projected (step S901).

[0138] Next, among the identified body parts of the projection target user, information on the body part on which image information is to be projected is acquired (step S902). Then, based on the acquired information on the body part, the position and orientation of the body part on which image information is to be projected at the current time is identified (step S903). Then, based on the identified position and orientation of the body part, it is determined whether or not image information can be projected onto the body part at the position and orientation (step S904).

[0139] In step S904, if it is determined that projection is not possible (step S904: No), a warning to that effect is given to the projection target user (step S905). This prompts the projection target user to move his / her position or change the position or orientation of a body part. Then, the process returns to step S901, and the processes of steps S901 to S905 are repeated.

[0140] In step S904, if it is determined that projection is possible (step S904: Yes), the projection position and projection size of the image information to be projected are determined (step S906). Then, based on the projection position and projection size of the determined image information, the projection position of the image projection device 200 is determined (step S907).

[0141] Next, the image projection device (own device) 200 is moved to the determined projection position and the projection angle is adjusted (step S908). After the movement and adjustment are completed, the image information is projected using the (identified) body part as a screen (step S909).

[0142] Thereafter, it is determined whether the position and orientation of the body part to be projected has changed (step S910). Whether the position and orientation of the body part to be projected has changed can be determined, for example, by performing identification by the body part information identifying unit 803 shown in Fig. 8 at predetermined time intervals (e.g., 0.5 seconds) and judging based on the difference between the information on the position of the body part identified the previous time (e.g., 0.5 seconds ago). If it is determined that the position and orientation of the body part to be projected has changed (step S910: Yes), the process returns to step S903, and the position and orientation of the body part to be projected is identified again (step S903), and thereafter, the process from step S904 onwards is performed.

[0143] If it is determined in step S910 that the position and orientation of the body part to be projected has not changed (step S910: No), then it is determined whether the body part to be projected has changed (step S911). Whether the body part to be projected has changed can be determined, for example, based on the information acquired by body part information acquisition unit 803 shown in Fig. 8. If the body part to be projected has changed (step S911: Yes), the process returns to step S902 to again acquire information on the body part onto which image information is to be projected (step S902), and thereafter, the processes from step S903 onwards are performed.

[0144] In step S911, if the body part to be projected has not changed (step S911: No), it is then determined whether the projection target user has moved (step S912). Whether the projection target user has moved can be determined, for example, by performing identification by the projection target user identification unit 802 shown in FIG. 8 at predetermined time intervals (e.g., 0.5 seconds) and based on the difference from information regarding the position of the projection target user identified the previous time (e.g., 0.5 seconds ago). Here, if the projection target user to be projected has moved (step S912: Yes), the process returns to step S901, and the current position of the projection target user is identified again (step S901), and thereafter, the processes from step S902 onwards are performed.

[0145] If it is determined in step S912 that the projection target user has not moved (step S912: No), then it is determined whether or not an instruction to end projection has been given (step S913). Whether or not an instruction to end projection has been given can be determined, for example, by whether or not an instruction to end projection has been given from user instruction receiving unit 801. Here, if there is no instruction to end projection (step S913: No), the process proceeds to step S910, and thereafter, each of the processes of steps S910 to S913 is repeated. On the other hand, if there is an instruction to end projection (step S913: Yes), the projection of image information is stopped (step S914), and the series of processes is terminated.

[0146] In this way, the image projection device 200 can project an image onto any part of the body of the user 201. Furthermore, even if the position or orientation of the body part changes, if the body part to be projected changes, or if the user 201 moves, the image projection can be continued.

[0147] <Another embodiment> Although the drone projector 200 has been described as an image projection device, the image projection device is not limited to this. For example, it may be an image projection device that is movably installed on an indoor wall or ceiling. The inventor named this image projection device a "movable projector (abbreviated as MuvaPro)." A movable projector has a variable projection direction, and the projector itself can move on the wall or ceiling.

[0148] Fig. 10 is an explanatory diagram showing an example of an image projection device (movable projector) 1000 according to another embodiment of the present invention and an environment in which the image projection device 1000 moves. In Fig. 10, the same parts as those in the image projection device 200 according to the above-mentioned embodiment are denoted by the same reference numerals. As shown in Fig. 10, the image projection device (movable projector) 1000 includes a moving body 1001. The moving body 1001 includes a main body 1002, a rolling body 1003, a magnet 1004, and a slide shoe 1005.

[0149] The main body 1002 has a substantially box-like shape and houses therein a control circuit 702, an antenna, a motor, a battery, etc. The control circuit 702 is composed of a CPU, a memory, etc., and drives and controls each unit of the image projection device 1000. Specifically, for example, the control circuit 702 drives and controls a motor 705 connected to a rolling element 1003 to rotate the rolling element 1003 and move the image projection device 1000.

[0150] The rolling body 1003 is connected to the main body 1002 so as to be rotatable (rollable). The rolling body 1003 protrudes from the end face of the main body 1002 toward the ceiling 1006 or wall 1007. It is preferable that three or more rolling bodies 1003 are provided. This allows the image projection device 1000 to move stably and smoothly.

[0151] Specifically, the rolling element 1003 can be realized by, for example, a roller, a ball, or a roll. By using a ball or a roll to realize the rolling element 1003, the turning radius of the moving element 1001 can be made small, so that the moving element 1001 can be made to turn with a small turning radius, and a high degree of freedom in movement can be ensured. When the rolling element 1003 is realized by a roller, the toe angle and caster angle are appropriately adjusted.

[0152] The magnet 1004 is provided on the same side of the main body 1002 as the rolling body 1003. The magnet 1004 attracts the image projection device 600 to the ceiling 1006 or the wall 1007 by magnetic force. The slide shoe 1005 has a sheet or plate shape. The slide shoe 1005 is made of a material that does not impair the magnetic force of the magnet 1004 that attracts the image projection device 1000 to the ceiling 1006 or the wall 1007 and does not provide resistance to the movement of the image projection device 600. Specifically, the slide shoe 1005 can be made of hard silicone rubber, for example.

[0153] The slide shoe 1005 is provided so that the end face opposite to the main body is located at the same position as the tip of the rolling element 1003 (the contact position of the rolling element 1003 with the ceiling 1006 or wall 1007) or slightly toward the main body. This allows the rolling element 1003 to be reliably brought into contact with the ceiling 1006 or wall 1007, and allows the image projection device 600 to be moved smoothly.

[0154] The slide shoe 1005 may be provided so as to be capable of approaching and releasably moving with respect to the magnet 1004 or the main body 1002. Specifically, for example, the slide shoe 1005 may be connected to the magnet 1004 or the main body 1002 via an elastic member such as a spring. This allows the rolling body 1003 to be reliably brought into contact with the ceiling 1006 or the wall 1007, and allows the image projection device 600 to be moved satisfactorily.

[0155] Such an image projection device 1000 may specify its current location using the GPS receiver 704 as described above, but is not limited to this. The image projection device 1000 may specify its current location using the principle of triangulation used in PHS (Personal Handy-phone System), for example. Specifically, for example, a plurality of PHS base stations (not shown) are provided on the ceiling 1006 or wall 1007, and the location of the device is specified by receiving radio waves output from these base stations via an antenna.

[0156] This makes it possible to specify and control the position of the image projection device 1000 with high accuracy even in an environment where it is difficult to receive radio waves from a GPS satellite due to the presence of a ceiling 1006 or a wall 1007. This makes it possible to project the image 502 at any position within a building. Since the image projection device 1000 moves along the ceiling 1006 or the wall 1007, it is possible to reliably prevent the user 201 from colliding with it, and ensure the safety of the user 201.

[0157] In this way, the image projection device 1000 can be moved using indoor facilities. The indoor facilities may be at least one of the indoor walls, ceiling, and floor, and the image projection device 1000 can be moved along the indoor facilities. This allows the image projection device 1000 to be moved to a desired position indoors, and an image can be reliably projected onto the desired part of the user 201.

[0158] As yet another embodiment, the image projection device may be a projector attached to the body of the user 201, although illustration is omitted. For example, a rechargeable projector may be built into or attached to glasses, a hat, or the like worn by the user 201.

[0159] Alternatively, the projector may be a portable information terminal device (such as a smartphone) type projector that is held and operated in one hand. In that case, the portable information terminal device may be owned by the user, or may be owned by someone other than the user.

[0160] As described above, the image projection method according to the embodiment of the present invention is characterized in that it identifies the position of user 201 and any part of the body of user 201 (for example, reference numerals 101, 102, etc.), and projects an image transmitted or distributed to user 201 onto the identified any part as screen 110, 120, 400, 500. Since the body can thus be used as a screen, the image can be viewed even if the user does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen in the vicinity.

[0161] The image projection method according to the embodiment of the present invention is further characterized in that the image projection device 200, 1000 that projects the image is moved to a position where the image can be projected onto an arbitrary part of the user 201. This makes it possible to reliably project the image onto the arbitrary part of the user 201.

[0162] Moreover, the image projection method according to the embodiment of the present invention is characterized in that the image projection device 200 is moved by the unmanned aerial vehicle 602. This allows the image projection device 200 to fly freely in a three-dimensional space and be moved to a desired position.

[0163] Also, the image projection method according to the embodiment of the present invention is characterized in that the image projection device 1000 is moved using indoor facilities. Furthermore, the indoor facilities may be at least one of an indoor wall, a ceiling, and a floor, and the image projection device 1000 may be moved along the indoor facilities. In this way, the image projection device 1000 can be moved to a desired position indoors, and an image can be reliably projected onto the desired part of the user 201.

[0164] Moreover, the image projection method according to the embodiment of the present invention is further characterized in that any part of the user 201 that becomes the screen is set by designation of the user 201. This allows the user 201 to project an image at a position that he or she desires and view the image.

[0165] Furthermore, the image projection method according to the embodiment of the present invention is further characterized in that an arbitrary part of the user 201 to be a screen is selected based on the content of the image. This allows an optimal part of the arbitrary part of the user 201 to be used as a screen for the image, thereby improving the visibility of the image.

[0166] Furthermore, the image projection method according to the embodiment of the present invention is characterized in that it changes the projection method for projecting an image based on the state of any part of the user 201 that serves as the screen. This makes it possible to recognize the state of any part, specifically, for example, the palm of the hand, whether it is a bare hand or a gloved hand, and change the projection method according to that difference, thereby realizing more optimal projection and improving the visibility of the image.

[0167] Furthermore, the image projection method according to the embodiment of the present invention is characterized in that the projection method for projecting an image is changed based on the surrounding conditions of an arbitrary part of the user 201, which serves as a screen. This makes it possible to recognize the surrounding conditions of an arbitrary part, specifically, differences in the surrounding brightness and the density of people, for example, and change the projection method according to those differences, thereby realizing more optimal projection and improving the visibility of the image.

[0168] In addition, the image projection method according to the embodiment of the present invention is characterized in that, in the above invention, the image projected on the screen is recognized, and the projection method is changed based on the recognized state of the image. This makes it possible to photograph the projected image, analyze the photographed image, and change the projection method so as to correct the projected image based on the analysis result, thereby realizing more optimal projection and improving the visibility of the image.

[0169] Moreover, the image projection method according to the embodiment of the present invention is characterized in that, in the above invention, the arbitrary part of the user 201 that becomes the screen is a part of the body of the user 201 that is visible to the user 201. For example, the arbitrary part of the user 201 that becomes the screen is a hand or an arm of the user 201. This makes it possible to easily use the hand or arm as a screen by simply moving the hand or arm, and to project the image more quickly.

[0170] Also, for example, the arbitrary part of the user 201 that becomes the screen is characterized by being the leg or foot of the user 201. This allows the user 201 to easily view the projected image, for example, when the user 201 is sitting. Also, since the area on the legs or feet that can become a screen is relatively large compared to the hands or arms, a large image can be projected.

[0171] Also, for example, the arbitrary part of the user 201 that becomes the screen is characterized by being the nail of a finger or a toe of the user 201. In this way, by using the nail, which is harder and shinier than skin, as the screen, the image can be projected more clearly.

[0172] Furthermore, the image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is a part of the body of the user 201 that can be viewed by the user 201 using a mirror. This allows the user 201's own body reflected in the mirror to be used as the screen, and the user 201 can see the contents of the image while looking at the mirror.

[0173] Furthermore, the image projection method according to the embodiment of the present invention is characterized in that when the image is projected onto a part that is visible to the user 201 using a mirror, the image is inverted from left to right. This makes it possible to prevent the image information from being difficult to read due to the characters being mirror-inverted, even when the image information is character information.

[0174] Moreover, the image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is the face, head, or neck of the user 201. This allows the user 201 to check the content of the image while looking at his or her own face in a mirror.

[0175] Moreover, the image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is the trunk or buttocks of the user 201. This allows the user 201 to check the content of the image while looking at his or her whole body in the mirror.

[0176] Moreover, the image projection method according to the embodiment of the present invention is characterized in that it identifies the position of user 201 and any part of the body of user 201, and projects an image transmitted or distributed to user 201 using clothing worn at the identified any part as a screen. For example, clothing may include at least one of clothes, gloves, shoes, socks, a hat, and a mask. As a result, user 201 can use clothing as a screen, and thus can view an image even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

[0177] The image projection method according to the embodiment of the present invention is further characterized in that the projection method for projecting an image is changed based on the type or state of clothing worn on any part of the user 201 that serves as the screen. For example, the projection method for projecting an image is changed based on at least one of the color and material of clothing worn on any part of the user 201 that serves as the screen. This makes it possible to recognize differences in the color and material of clothing and change the projection method according to these differences, thereby achieving more optimal projection and improving the visibility of the image.

[0178] Moreover, the image projection devices 200 and 1000 according to the embodiments of the present invention are characterized by including a control unit (control circuit 702) that identifies the position of the user 201 and any part of the body of the user 201, and projects an image transmitted or distributed to the user 201 using the identified any part as a screen. This allows the user 201 to use his or her body as a screen, so that the user can view an image even if he or she does not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby.

[0179] Moreover, the image projection devices 200 and 1000 according to the embodiments of the present invention are characterized by including a control unit (control circuit 702) that identifies the position of the user 201 and any part of the body of the user 201, and projects an image transmitted or distributed to the user 201 using the clothes ("clothes") of the identified any part as a screen. This allows the user 201 to use the clothes as a screen, so that the user 201 can view the image even if he or she does not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby.

[0180] Moreover, the image projection device 200, 1000 according to the embodiment of the present invention is further characterized in that the control unit (control circuit 702) moves the image projection device 200, 1000 that projects the image to a position where the image can be projected onto an arbitrary part of the user 201. This makes it possible to reliably project the image onto the arbitrary part of the user 201.

[0181] Moreover, unmanned aerial vehicle 602 according to an embodiment of the present invention is characterized in that it identifies the position of user 201 and any part of the body of user 201, and projects an image transmitted or distributed to user 201 using the identified any part as a screen. Moreover, unmanned aerial vehicle 602 according to an embodiment of the present invention is characterized in that it includes a control unit (control circuit 702) that identifies the position of user 201 and any part of the body of user 201, and projects an image transmitted or distributed to user 201 using clothing worn at the identified any part as a screen. Moreover, unmanned aerial vehicle 602 according to an embodiment of the present invention is characterized in that it moves to a position where an image can be projected onto the any part, and projects the image.

[0182] This allows the robot to fly freely in three-dimensional space, move to a desired location, and project an image. Because the user 201 can use his or her body or clothing as a screen, the user can view the image even if he or she does not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby.

[0183] The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device to execute a process of identifying the position of the user 201 and an arbitrary part of the body of the user 201, and projecting an image transmitted or distributed to the user 201 using the identified arbitrary part as a screen. The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device to execute a process of identifying the position of the user 201 and an arbitrary part of the body of the user 201, and projecting an image transmitted or distributed to the user 201 using clothing worn on the identified arbitrary part as a screen. The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device 200, 1000 to execute a process of moving the image projection device that projects the image to a position where the image can be projected onto the arbitrary part.

[0184] This allows the image projection devices 200 and 1000 to be moved to desired positions to project images. The user 201 can view images even if he or she does not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby, because the user 201 can use his or her body or clothing as a screen.

[0185] The image projection method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. The program is recorded on a computer-readable recording medium such as a hard disk, CD-ROM, MO, DVD, USB memory, SSD, etc., and is executed by being read from the recording medium by the computer. The program may also be a transmission medium that can be distributed via a network such as the Internet. [Industrial Applicability]

[0186] As described above, the image projection method, image projection device, unmanned aerial vehicle, and image projection program of the present invention are useful for an image projection method, image projection device, unmanned aerial vehicle, and image projection program that project an image, and are particularly suitable for an image projection method, image projection device, unmanned aerial vehicle, and image projection program that project an image using the body as a screen. [Explanation of symbols]

[0187] 110, 120 Palmtop Screen 200 Image projection device (drone projector) 201 users 400 Arm Top Screen 500 List Top Screen 601 Projector 602 Drone 603 Camera 604 Human Sensor 801 User Instructions Reception Department 802 Projection target user identification unit 803 Body part information acquisition unit 804 Projection image information acquisition unit 805 Body part identification section 806 Projection position and projection size determination unit 807 Warning Output Unit 808 Movement position / projection angle determination unit 809 Movement and projection angle control unit 810 Image information projection unit 811 Projection image capture unit 812 Instruction output unit 1000 Image projection device (movable projector)

Claims

1. 1. An image projection method for projecting an image transmitted or distributed to a user using an image projection device, comprising: The image projection device, After the user is notified of the reception of the image, an instruction to start projecting the image is received from the user; When the instruction to start the projection is received, a current position of the user is identified, and a position and orientation of a body part to be projected or clothing in the body part to be projected is identified based on an instruction to select a projection part by the user; If it is determined that projection is possible based on the specified position and orientation, moving the image to a position where the image can be projected onto the body part to be projected or onto clothing of the body part to be projected, and adjusting the projection angle; An image projection method, comprising: projecting the image onto the body part to be projected or onto clothing of the body part to be projected, as a screen.

2. The image projection method according to claim 1 , wherein the image projection device is movably installed on a wall or ceiling of a room where the user is present.

3. The image projection method according to claim 1, characterized in that the image projection device moves by flying an unmanned aerial vehicle, and notifies the user of receipt of the image by flying around the user.

Citation Information

Patent Citations

  • Automatic movement type air floating image display device

    JP2005338114A

  • Information presentation controller and information presentation control method

    JP2009151380A

  • Information transmission device

    JP2017076084A

  • Video display system

    JP2018125816A

  • Control device, aircraft, and control program

    JP2019008676A