Image projection method and image projection device

Abstract

To enable a viewing of image information without carrying a display device such as a portable terminal device, or without providing the display device such as a display and a screen at a circumference.SOLUTION: An image transmitted or a distributed to a user 201 by using an optional portion specified as a screen is projected by using a projector (a "drone projector") 200 mounted onto a drone by specifying a user 201 and a position of the optional portion of a body of the user 201. Thus, a "palm-top screen" 110 can be realized in any one of right and left hands of the user 201. A portion of the body may be an arm, a wrist, a leg, a foot, or the like. The user 201 does not require a display and a dedicated screen for viewing an image.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an image projection method for projecting an image, and an image projection device for implementing the image projection method. , unmanned aerial vehicles, and image projection programs. [Background technology]

[0002] In recent years, the opportunities to view images on information terminal devices such as smartphones have become more diverse. As a related technology, specifically, for example, there has been a robot capable of autonomous driving. The robot is equipped with a projection unit that detects the state of the projection surfaces around it and projects the image onto the surface. By projecting an image, it is possible to display an image that is easily visible to the general public. There is a technique for such a video display system (see, for example, Patent Document 1 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-125816 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, if you do not have a display device such as an information terminal device, In places where a display device such as a ray was not installed, image information could not be viewed. In addition, the projector can only project images onto a pre-defined screen. was not possible.

[0005] In addition, in the conventional technology described in the above-mentioned Patent Document 1, image information addressed to an individual cannot be viewed. However, there was a problem that the system was not suitable for such a purpose.

[0006] In order to solve the above-mentioned problems of the conventional technology, the present invention relates to a display device for a mobile terminal device, etc. Even if you are not carrying a device or if a display device such as a display or screen is nearby, Image projection method for allowing users to see image information without needing to use a computer, and a display device for realizing the image projection method The present invention aims to provide an image projection device, an unmanned aerial vehicle, and an image projection program. [Means for solving the problem]

[0007] In order to solve the above problems and achieve the object, the image projection method according to the present invention provides a The position of the user and an arbitrary part of the user's body are identified, and the identified arbitrary part is scanned. The present invention is characterized in that the image transmitted or distributed to the user is projected as a screen. do.

[0008] In the image projection method according to the present invention, the image is projected on the arbitrary and moving an image projection device that projects the image to a position where the image can be projected onto the part. do.

[0009] In addition, the image projection method according to the present invention is the above-mentioned method, further comprising the steps of: The feature is that transportation is carried out using a manned aircraft.

[0010] In addition, the image projection method according to the present invention includes the steps of: projecting the image projection device indoors. The feature of this method is that it uses equipment inside the building to move the vehicle.

[0011] In the image projection method according to the present invention, the indoor equipment is At least one of the walls, ceilings and floors of the interior of the building, and the The image projection device is moved.

[0012] In addition, the image projection method according to the present invention is the above-mentioned screen. The arbitrary part of the user is set by designation of the user.

[0013] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is selected based on the content of the image. .

[0014] In addition, the image projection method according to the present invention is the above-mentioned invention, A projection method for projecting the image is changed based on a state of the arbitrary part of the user. It is characterized by:

[0015] In addition, the image projection method according to the present invention is the above-mentioned invention, A projection method for projecting the image is changed based on a surrounding situation of the arbitrary part of the user. The feature of this invention is that it changes the

[0016] In the image projection method according to the present invention, the periphery of the arbitrary part is The situation is characterized by the brightness of the surroundings.

[0017] In addition, the image projection method according to the present invention includes the steps of: projecting an image onto the screen; The present invention is characterized in that it recognizes the image projected and changes the projection method based on the situation of the recognized image. Let us assume that.

[0018] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is a part of the user's body that is visible to the user. It is characterized in that:

[0019] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is characterized in that it is a hand or an arm of the user.

[0020] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is characterized in that it is a leg or a foot of the user.

[0021] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is a nail of a finger or a toe of the user. Let us assume that.

[0022] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is a part of the user's body that the user can see using a mirror. It is characterized by being a possible site.

[0023] In the image projection method according to the present invention, the user may use a mirror. When the image is projected onto a portion where it can be seen by the human eye, the image is inverted left and right. Let us assume that.

[0024] In addition, the image projection method according to the present invention is the above-mentioned invention, The any part of the user is the face, head or neck of the user. do.

[0025] In addition, the image projection method according to the present invention is the above-mentioned invention, The arbitrary part of the user is a trunk or a buttocks of the user. .

[0026] The image projection method according to the present invention is also directed to a user and any part of the user's body. The position of the user is identified, and the user uses the clothes at the identified arbitrary part as a screen. The present invention is characterized by projecting an image transmitted or distributed to a target object.

[0027] In the image projection method according to the present invention, in the above-mentioned invention, the clothing includes clothing, hands, The kit includes at least one of a bag, shoes, socks, a hat, and a mask.

[0028] In addition, the image projection method according to the present invention is the above-mentioned invention, The image is projected based on the type or state of clothing worn on the arbitrary part of the user. The feature of this method is that it changes the projection method used.

[0029] In addition, the image projection method according to the present invention is the above-mentioned invention, Based on at least one of the color and material of the clothing of the user in the arbitrary part, The projection method for projecting the image is changed based on the projection method.

[0030] In order to solve the above problems and achieve the object, the image projection device according to the present invention is The position of the user and an arbitrary part of the user's body are identified, and the identified arbitrary part is scanned. and a control unit for projecting an image transmitted or distributed to the user as a screen. This is characterized by the fact that

[0031] The image projection device according to the present invention is also capable of projecting a light onto a user and any part of the user's body. The position of the user is identified, and the user uses the clothes at the identified arbitrary part as a screen. The present invention is characterized by including a control unit that projects an image transmitted or distributed to the

[0032] In the image projection device according to the present invention, the control unit controls the image projection device to project the image. Move an image projection device that projects the image to a position where the image can be projected onto the arbitrary portion. It is characterized by:

[0033] In order to solve the above problems and achieve the object, the unmanned aerial vehicle according to the present invention is And the position of an arbitrary part of the body of the user is specified, and the specified arbitrary part is screened. The present invention is characterized in that the image transmitted or distributed to the user is projected as a display. .

[0034] In addition, the unmanned aerial vehicle according to the present invention can detect the movement of a user and any part of the user's body. The position is specified, and the clothing at the specified arbitrary part is used as a screen to display the image to the user. The device is characterized by projecting an image transmitted or distributed to the screen.

[0035] In addition, in the unmanned aerial vehicle according to the present invention, in the above-mentioned invention, the image is The device then moves to a position where it can project the image, and projects the image.

[0036] In order to solve the above problems and achieve the object, the image projection program according to the present invention , identifying the position of the user and any part of the user's body, and identifying the identified any part A process of projecting an image transmitted or distributed to the user onto a screen, The present invention is characterized in that the image projection device executes the above-mentioned method.

[0037] In addition, the image projection program according to the present invention is for projecting a user and any part of the user's body. The position of the arbitrary part is specified, and the clothes at the specified arbitrary part are used as a screen, The image projection device executes a process of projecting an image transmitted or distributed to a user. It is characterized by:

[0038] In addition, an image projection program according to the present invention includes, in the above-mentioned invention, The image projection device projects the image to a position where the image can be projected onto the arbitrary portion. The present invention is characterized in that it executes a process for moving the device. Effect of the Invention

[0039] IMAGE PROJECTION METHOD, IMAGE PROJECTION DEVICE, UNMANNED AIRCRAFT, AND IMAGE PROJECTION PROGRAM BASED ON THE PRESENT APPLICATION According to the report, a user can view the content even if he / she does not have a display device such as a mobile terminal device or if You can view image information even if there is no display device such as a display or screen nearby. This has the effect of: [Brief description of the drawings]

[0040] [Figure 1] This is an explanatory diagram (part 1) showing an overview of an image projection method ("palmtop screen"). [Diagram 2] This is an explanatory diagram (part 2) showing an overview of the image projection method ("drone projector"). [Diagram 3] This is an explanatory diagram (part 3) showing an overview of the image projection method ("palmtop screen"). [Figure 4] This is an explanatory diagram (part 4) showing an overview of the image projection method ("Arm Top Screen"). [Diagram 5]This is an explanatory diagram (part 5) showing an overview of the image projection method ("wrist-top screen"). [Figure 6] FIG. 1 is an explanatory diagram showing an example of the appearance of an image projection device (drone projector). [Figure 7] FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of an image projection device. [Figure 8] FIG. 2 is a block diagram showing an example of a functional configuration of the image projection device. [Figure 9] 11 is a flowchart showing an example of a processing procedure of the image projection device. [Figure 10] FIG. 11 is an explanatory diagram showing an example of an image projection device (a movable projector) according to another embodiment of the present invention and an environment in which the image projection device moves. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0041] The image projection method and the image projection method according to the present invention will be described below with reference to the accompanying drawings. A detailed description will now be given of preferred embodiments of the image projection device, the unmanned aerial vehicle, and the image projection program. do.

[0042] (Overview of image projection method) 1 to 5 are explanatory diagrams showing an outline of an image projection method. In FIG. Image information 110 related to the video call is projected onto the right hand 101. In addition, the left hand 102 displays image information related to the chat screen. 120 is projected. In addition, a desired image of the user may be projected on the right hand 101 and the left hand 102. For example, image information can be projected onto both hands, right hand 101 and left hand 102. Image information 110 relating to video calls with different parties may be projected. The image is projected onto the palm of at least one of the user's hands. The use of a screen as a palm-top screen is called a "palm-top screen." EEN”).

[0043] When projecting an image related to a video call, the voice of the other party in the video call, etc. The accompanying sound is transmitted through earphones worn by the user or through speakers placed near the user. The speaker can be output from the image projection device 200 shown in FIG. A speaker 707 shown in FIG. 7 may be installed. The input is from earphones worn by the user or a microphone installed near the user. The microphone may be mounted on the image projection device 200 ( (Microphone 706 shown in FIG. 7, which will be described later).

[0044] FIG. 2 shows an example of a video call system in which an image projection device 200 projects image information related to a video call onto the palm of a user 201. As shown in FIG. 2, the image projector 200 projects an image 110 onto the user's screen. By projecting image information 110 onto the palm of the hand, which is an arbitrary part of the body of the user 201, The palm of the user's 201 body can be used as a screen. The image projection device 200 is a drone (unmanned aerial vehicle) that is equipped with a projector and flies the drone. The robot stops in a predetermined space while moving, and captures image information from the robot at any part of the user's body (201). The inventors call this image projection device 200 a "drone projector." They named the project "DRONE PROJECTOR" (abbreviated as "DRONE PROJECTOR").

[0045] By using the palm of your hand as a screen, you no longer need a dedicated display device to view image information. No. Depending on the direction of your palm, other people nearby may be able to see your image information. Also, depending on the direction of your palm, you can prevent the person next to you or the person opposite you from touching you. You can also share and view image information with others in the same place.

[0046] As shown in FIG. 1, by using both hands, a user can view at least two different images. In order to display two different image information, the two sides can be viewed simultaneously. A drone may be equipped with two or more projectors, and multiple drone projectors may be used. Alternatively, as shown in FIG. 2, By bringing both hands close together or touching each other, one image is enlarged and displayed across both hands. It is also possible.

[0047] As can be seen from FIG. 1 and FIG. 2, the image information 110 and 120 are of outstretched hands. The image is projected onto the palm by the image projection device 200. In order to project 110 and 120 onto the palm of the user 201, the image projection device 200 First, a user 201 to whom image information is to be projected is identified. Then, The position of the palm is identified, and the identified palm is used as a screen to display the image to the user 201. The user 201 projects the image that is transmitted to the palm of his / her hand. The projected image information 110 and 120 can then be visually recognized.

[0048] As shown in FIG. 3, the direction of the image information 110 is determined by the user's line of sight (the position of both eyes) and the position of the hand. It may be determined based on the relationship with the position of the palm 101. Regardless of the direction in which the image is viewed, the image can be displayed at an angle that is easy for the user to view from the position of the left and right eyeballs of the user 201. The orientation of the image information may be determined by inferring the orientation of the image information. It can be seen that the direction in which the image 110 is projected is different. The orientation of the image 110 is changed depending on the direction in which the user 201 Even if the angle of the hand is changed, the direction in which the image is projected relative to the line of sight of the user 201 remains constant. This makes it possible to improve the visibility of the image information 110.

[0049] The direction in which the image information is projected can be adjusted based on the voice of the user 201 (for example, "I want to see the person across from me"). Make it visible') or by gestures (e.g. In this way, the user 2 can Not only 01. It also makes it easier for others next to or across from you to see the image information.

[0050] If the angle of the palm is changed or the position of the palm is moved, the image projection device 200 The system recognizes the change and continues to transmit image information to the user by tracking the change in the angle and position of the palm. Therefore, the projection can be continued on the palm of the user 201. Until an instruction to end the process is given, the image information is displayed continuously, for example, as if it were displayed on a display device. can be projected onto the palm of your hand.

[0051] The size of the image information is determined based on the size and shape of the palm of the user 201. The size of the image information when projected onto the palm of the hand varies for each user 201. This allows image information of the same size to always be displayed on the palm of the hand. Therefore, the user 201 is less likely to feel uncomfortable every time he or she sees image information. do.

[0052] The dimensions of the image information may be changed according to an instruction from the user 201 . The user 201's instruction to change the size may be given by voice (e.g., "make it bigger" or "make it smaller"). "Make it smaller!" or by gestures (e.g. pointing to the desired size with your finger) The sound may be collected by a microphone 706 mounted on the image projection device 200 or the like. Alternatively, the instruction of the user 201 may be recognized by voice recognition or the like. The camera 6 shown in FIG. 6 and FIG. 7 is mounted on the image projection device 200. 03) and recognizes the instructions of the user 201 by image recognition or the like. Good too.

[0053] Notification of image reception can be by chime, alarm, or voice ("You have received a message from Mr. / Ms. XX"). The sound is outputted by a speaker 707 shown in FIG. The image can be sent to the user's earphones or the camera. The image can be sent to the user's earphones or the camera's earphones. Also, notifications can be sent by vibrating your belongings. Furthermore, the drone projector 200 may fly in front of the user 201. The notification may be given by sending a notification message to the user.

[0054] When the image reception is notified, the user 201 instructs to start projection. Specifically, the instruction may be, for example, a voice ("show me") or a specific gesture. Next, the user 201 designates the projection position. The projection position can be specified, for example, by vocalization ("back of the left hand") or gesture (hand Open your palm up. Make a gesture of looking at your watch. Point your finger at the desired location. The projection start instruction and the projection position instruction may be a series of operations. For example, say "Show it on the thigh of the left leg." Also, point to the left arm with the index finger of your right hand. .) In this way, the intent of the user 201 can be confirmed.

[0055] FIG. 4 shows an example of projection onto a body part of the user 201 other than the palm. As shown in FIG. 4, depending on the display format of the image information to be displayed, for example, the image information may be displayed on the left hand side. The display may be long and continuous, extending from the wrist along the arm to the shoulder. Using your arm as a screen in this way is called an "arm top screen." In FIG. 4, the arm top screen 400 is In this way, the length of the arm is used to compare the distance between the person and the person. It can display relatively large images, enabling easier navigation. The arm-top screen 400 can display map information and other information by standing on the arm. This allows you to project a vertically long image, such as a chat screen, for example, with a large number of chats. Cut.

[0056] (An example of a body part onto which image information is projected) The body part onto which the image information is projected may be any body part that is visible to the user 201 . The body part onto which the image information is projected may be the hand or arm of the user 201. The hand is not limited to the palm. Specifically, for example, the back of the hand is also acceptable. The inventors have proposed using the back of the hand as a screen other than the palm. He named it the "HAND TOP SCREEN." .

[0057] The body part onto which the image information is projected may be, for example, a finger. The term "finger top screen" refers to using the finger as a screen. The part that is projected onto the fingers is the palm side. It can be either the palm side or the back of the hand, or both, or both the palm side and the back of the hand. The finger may be in the middle of the finger. Also, a message of about one to three lines may be written on the finger. Character information can be displayed along the length of the fingers. Alternatively, consecutive text information may be displayed on each finger. stomach.

[0058] In addition, as an example of a "finger top screen," there is a "nail screen" that uses a fingernail as a screen. A "nail top screen" may be included. In this way, by using the nail, which is harder and shinier than the skin, as a screen, the image can be more clearly It is possible to project images clearly. Depending on the destination of the image information, it is possible to select which fingernail is projected onto. By deciding in advance, you can instantly and intuitively know the destination of the image information. (The nail on the thumb of the right hand is given to Person A, the nail on the middle finger of the left hand to Person B, etc.) In addition, it is possible to determine in advance which fingernail to project onto based on the content of the image information. For example, urgent messages could be written on the nail of the right thumb.

[0059] As another example of the user's hand or arm, which is a body part onto which image information is projected, The wrist as shown in FIG. 5 may be used as a screen. The inventors refer to using the wrist as a screen as a “wrist We named it “LIST TOP SCREEN” as shown in Figure 5. Thus, the wrist-top screen 500 displays image information in a position that is almost the same as the display position of a wristwatch. Therefore, the user can see the display on the wrist-top in the same way as if they were looking at a wristwatch. The screen 500 can be seen in FIG. It may be the wrist on the back side of the hand, as shown in FIG. 1, or the wrist on the palm side of the opposite hand, as shown in FIG. It may also be the wrist area between the back of the hand and the palm.

[0060] Additionally, the body part onto which the image information is projected may be the leg or foot of the user 201 . For example, when the user 201 is sitting, the user may use their legs or feet as a screen. You can easily see the projected image by using a "laptop screen". "LAP TOP SCREEN" (laps, or knees when sitting on a chair, etc.) "LEG TOP SCREEN" N")" (the whole leg, including the calf when crossing the legs), "Foot Top Screen (" FOOT TOP SCREEN” (instep, sole, foot) The ankle may be a "leg top screen". " or "Foot Top Screen".

[0061] The legs or feet have a relatively large screen area compared to the hands or arms, so they display images better. It can project a larger image than the original. It can also be used as a screen with your hands or arms. This allows you to see more image information.

[0062] In addition, toenails are used as an example of a "foot top screen" just like fingernails. The nail top screen may include a "nail top screen."

[0063] In addition, the body parts onto which the image information is projected are usually difficult to see, but by using a mirror, etc. A body part visible by the (“FACE TOP SCREEN”), especially the cheeks), and the head (“HEAD TOP SCREEN”). "HEAD TOP SCREEN" especially on the forehead or where hair grows The neck (the "NECK TOP SCREEN") is a Shoulder top screens and shoulder top screens EEN”)). All of these names were given by the inventors.

[0064] In addition, the part of the body onto which image information is projected is the back ("back top screen"). "ABD TO K TOP SCREEN") and abdomen ("ABD TO K TOP SCREEN") The trunk, buttocks, and hips ("HIP TOP SCREEN") are These names may also be given by the inventor. If a mirror or similar is used, the image information should be mirror-inverted (reversed left and right). The nose and ears can be projected onto the face. Included in the "Top Screen".

[0065] In particular, the user's 201 own face ("face top screen") and neck ("neck top") Top screen), shoulders ("shoulder top screen"), and head ("head top screen") By projecting images onto a mirror in a room, for example while putting on makeup, You can check the image information while washing or cutting your hair.

[0066] In addition, in the case of the trunk or buttocks, the user 201 looks at his / her whole body in a mirror. You can check the image information while

[0067] As an application of these, image information can be used to display makeup, clothing, accessories (such as glasses), and jewelry (such as necklaces). These image information can be directly sent to the user. The images will be projected onto 201 different body parts, allowing you to enjoy virtual makeup and trying on clothes. To be used during surgery, such as to indicate the location of the affected area on the corresponding part of the body. In addition, by projecting the ideal body line directly onto the body, It can also be a goal for the team.

[0068] In this way, by using each part of the user's body as a screen, In addition, the user does not need a dedicated device such as a screen. There is no need to carry a terminal device (so-called "empty-handed" good).

[0069] The part of the body on which the image information is to be projected is selected by the user. Instructions can be given by voice (for example, "Display it on the back of your right hand" or "Display it on the wrist of your left hand") or It may be a gesture (for example, pointing at a desired location for projection). Depending on the type of information, the body part onto which the image information is projected may be selected. For example, highly confidential information can be displayed on the palm of the hand, and the orientation, angle, and distance of the palm from the face can be monitored. By adjusting the brightness, you can prevent people nearby from seeing the content of the image. Cut.

[0070] In addition, the part may be selected according to the user's posture. When you are holding something in one hand or working on something, you can project it onto your knees or legs. If you are doing some kind of work, you can project it onto your other hand or other body part.

[0071] The image information may be projected directly onto the skin of the user's body or through clothing. If the light source is attached to the skin, it may be projected onto the clothing. You can change the projection method (color, brightness, etc.) depending on whether you are wearing the costume or not. The difference can be determined by the type of the image projector installed. This can be determined by analyzing images taken by a camera installed in the vehicle.

[0072] (An example of the external appearance of the image projection device 200) Next, an example of the appearance of the image projection device according to the embodiment of the present invention will be described. FIG. 6 is an explanatory diagram showing an example of the appearance of an image projection device. As shown in FIG. The drone projector 200 includes a projector (projection unit) 601 and a drone The drone is equipped with an unmanned aerial vehicle (UAV) 602, a camera 603, and a human sensor 604. That is, the projector 601, the camera 603, and the human sensor 604 control the drone 60. It is installed in 2.

[0073] The projector 601 includes a projector light source, an optical system, a projection lens, etc. (Both are not shown in the figure). The projector 601 emits light from a projector light source. The light is guided along a predetermined path by an optical system and projected onto a projector 601 via a projection lens 601a. By shining light onto the outside of the device, an image is projected onto the surface where the light is being shone. Integrator lens that improves the uniformity of the illuminance of the light emitted from the projector light source, non-polarized light A polarization conversion element that converts (polarizes) the light emitted from the source into a specified polarization direction, a projector light A dichroic mirror separates the light from the LCD panels display images according to the light, and digital cameras combine the images of each color displayed by each LCD panel. It is composed of an ichroic prism and other components (both not shown in the figure).

[0074] The projector 601 may be, for example, a projector that uses a laser as a light source. A laser projector can be used. By using the laser beam splitter, the projector 601 can be made smaller. The laser type projector uses a mercury lamp as the projector light source. It can generate less heat than conventional projectors, so it can be equipped with a cooling fan and other mechanisms. By omitting it, it is possible to reduce the size and weight.

[0075] In addition, by using a laser projector, it can start up quickly and project images. In addition, by using a laser projector, Compared to silver lamp projectors, this projector consumes less power and projects brighter images. It is possible to achieve this.

[0076] Mercury lamp projectors should be used with the projection (optical axis) direction horizontal. The recommended projection direction is limited because the projection is not possible with laser-based projection. The projector can be used with the optical axis tilted relative to the horizontal. Laser projectors offer a high degree of freedom in the direction of projection, making it possible to project images onto walls. It can also project images onto the ground and floor.

[0077] The drone 602 moves the projector 601. By moving the projector 601 by the drone 602, the projector 6 The drone 602 can move the projection location of the image by the drone 601. For example, a quadcopter with four propellers 605 can be employed. The Lone 602 is not limited to quadcopters, but also includes hexacopters with six propellers. It uses various types of multicopters, such as helicopters and octocopters with eight propellers. It is possible.

[0078] The projector 601 is fixed to the drone 602 and is projected on the drone 602 when the drone 102 moves ( The projector 601 moves with the drone 602. The projector 60 may be connected in an adjustable state. 1 is connected to the bottom of the drone 602 via a universal joint such as a ball joint. The projector 601 can be attached to the drone via a universal joint such as a ball joint. By connecting it to 602, the projector 601 can be adjusted with a high degree of freedom. It can be secured.

[0079] In this case, the image projection device 200 changes the appearance of the projector 601 relative to the drone 602. In order to adjust the momentum without human intervention, the appearance of the projector 601 relative to the drone 602 is The actuator may include a drive mechanism for varying the force. The drive mechanism may be, for example, a motor or a gear train. The appearance of the projector 601 relative to the drone 602 By making the projection angle adjustable, the image can be projected at the optimal angle depending on the location where the image is to be projected. It is possible.

[0080] The camera 603 captures an image of the user 201 shown in FIG. The camera 603 captures the image projected by the projector 601. The camera 603 can be realized by a digital camera. With the lens 603a facing in the same direction as the projection direction of the image by the camera 601, It is fixed at 602.

[0081] The camera 603 has a lens facing the direction in which the image is projected by the projector 601. The camera may be connected to the drone 602 in such a way that the direction of the camera can be adjusted. The camera 603 is rotated around the axis that connects the camera 603 to the drone 602. The camera 603 is attached to the bottom of the drone 602 using a ball joint or other suitable attachment. The camera 603 may be connected via a universal joint such as a ball joint. By connecting the camera 603 to the drone 602, the camera 603 can be adjusted with high degree of freedom. can be secured.

[0082] In this case, the image projection device 200 adjusts the direction in which the lens 603a is pointed without manual intervention. In order to achieve this, a driving mechanism is provided to change the attitude of the camera 603 relative to the drone 602. The drive mechanism may be, for example, a motor, a gear train, etc. The direction in which the lens 603a is pointed relative to the projection direction of the image by the projector 601. By making the distance between the camera and the projector 601 adjustable, the projector 601 can project a single image using a single camera 603. It is possible to capture a projected image or an image of the surroundings of the image projection device 200. do.

[0083] In the image projection device 200, the attitude of the projector 601 relative to the drone 602 is and a driving mechanism for adjusting the attitude of the camera 603 relative to the drone 602. Each of the projectors 601 may operate independently. While projecting an image, the projected image is photographed by the camera 603, or the camera By adjusting the attitude of 603, it is possible to capture an image in a direction different from the projection direction of the image.

[0084] The camera 603 is not limited to a general-purpose digital camera. For example, Night vision cameras that can take pictures in dark places by amplifying their sensitivity, and cameras that are sensitive to infrared rays This may be achieved by an infrared camera. By installing such a camera 603, Even at night, the user and any part of the user can be captured without using a light source for auxiliary imaging. In addition, the image projected by the projector 601 can be captured clearly. This makes it possible to suppress increases in weight and power consumption of the image projection device 600.

[0085] The human presence sensor 604 detects a user present within a predetermined range from the image projection device 200. The user is the object to be visually perceived by the image projected by the image projection device 200. Specifically, the sensor 604 can be realized by an infrared sensor, for example. The infrared sensor detects infrared rays emitted by the user or other object by absorbing them with a light-receiving element. The temperature sensor detects the temperature rise (temperature change) caused by infrared rays and outputs a specified electrical signal. By using sensors, it is possible to detect the presence or absence of a viewer and their movement. Cut.

[0086] The detection range of the human sensor 604 realized by the infrared sensor is For example, the sensitivity of the infrared sensor, the number and layout of the sensor elements (pixels), The amount of human movement can be adjusted by adjusting the amplification factor of the current sensed by the human sensor. The sensor 604 is not limited to an infrared sensor, but may be, for example, an ultrasonic sensor. Alternatively, the user 201 may be detected by infrared light or visible light. A combination of methods may also be used to detect the user 201.

[0087] In this way, the image projection device 200 can project images in space by flying indoors and outdoors. This drone projector can be moved to a different location. The projector can be a personal drone projector or a shared projector for multiple users. It may also be a public drone projector.

[0088] (Hardware configuration of image projection device 200) Next, the hardware configuration of the image projection device 200 will be described. FIG. 7 is an explanatory diagram showing a hardware configuration of the image projection device 200. The hardware of the 00 includes a battery 701, a control circuit 702, a communication I / F 703, and a GPS. Receiver 704, motor 705, projector 601, camera 603, motion sensor 6 704, a microphone 706, and a speaker 707. The units 601, 603, 604, 701 to 707 are connected by a bus 700. There are.

[0089] The battery 701 supplies the power required for the operation of each unit of the image projection device 200. The battery 701 is, for example, a secondary battery (rechargeable battery, storage battery) such as a lithium battery. The battery 701 realized by a secondary battery can be realized by It may be detachable from the ring 602.

[0090] The image projection device 200 also includes a charging contact for charging the battery 701. The charging contact may be, for example, in the form of an exposed terminal, or in the form of a connector. Alternatively, the image projection device 200 may include a charging unit for charging the battery 701. Instead of or in addition to electrical contacts, wireless power transmission er Transfer, Contactless Power Transmissi The power receiving coil may be provided at a power receiving portion.

[0091] Wireless power supply receives power from the battery 701 without going through a charging contact. This is a technology for powering a device with a power source, which is also called non-contact power supply or wireless power supply. The lid 602 is provided on the inside of the exterior surface of the lawn 602. This prevents the lid 602 from being damaged by rain or dew. This can prevent deterioration or breakdown of the image projection device 200. This may be achieved by a primary battery that only discharges current power.

[0092] The control circuit 702 is configured with a CPU, a memory, etc., and is provided in the image projection device 200. The CPU controls the operation of each part by executing the programs stored in the memory. The memory is used to control the entire image projection device 200. The memory also stores, for example, image information relating to the image to be projected. Stores various information.

[0093] Specifically, memory is, for example, IC memory or SSD (Solid State Drive). The memory can be realized by a memory device such as a memory card. On the other hand, a removable memory card is inserted through a card slot provided in the image projection device 200. The memory card may be, for example, a Secure Digital (SD) This function can be realized by an IC card such as a memory card. This function may be realized by an attached hard disk or USB memory. stomach.

[0094] Specifically, the control circuit 702 includes, for example, a flight controller and an ESC (Electronic Steering Controller). A control circuit 702 is provided. In addition, BEC (Battery Elimination Circuit) and U The battery 701 may be equipped with a BEC (Universal BEC). When a secondary battery is used, the control circuit 702 controls the charging (storage) of the battery 701. The charging circuit may include a charging circuit that performs the steps.

[0095] The flight controller performs calculations related to the rotation control of the motor 705 and generates a control signal. The ESC controls the motor based on the control signal output from the flight controller. The flight controller controls the rotation of the image projection device 200 during flight. The tilt of the projection device 200 is detected and calculations are repeatedly performed, and the motor 705 is The control signal is output recursively.

[0096] The flight controller controls the propeller (propeller motor 705) relative to the ESC. It outputs a control signal to control the direction and speed of rotation. By outputting a control signal to control the rotation of the propellers in the opposite directions, an image projection device In addition, for example, the propeller at the front of the aircraft is rotated to the propeller at the rear of the aircraft. The image projection device 200 is moved forward by controlling the rotation of the rotor to be slower than that of the rotor. For example, the propeller on the right side of the aircraft's direction of travel should rotate slower than the propeller on the left side of the aircraft's direction of travel. By controlling the image projection device 200 to rotate to the right, the image projection device 200 is rotated to the right.

[0097] Specifically, the control circuit 702 controls the image projected by the projector 601. A GPU (Graphics Processing Unit) specialized for image processing It includes a GPU, which allows fast-moving videos to be projected in high quality. It is possible.

[0098] The communication I / F 703 connects the image projection device 200 to the network N through a communication line. An interface between the network N and the inside of the image projection device 200. It controls the interface and receives data from external devices connected via network N. The network N controls the input and output of data to an external device. Net, LAN (Local Area Network), WAN (Wide Area This can be achieved through the use of a Network.

[0099] The communication I / F 703 is, for example, a wireless interface using Wi-Fi (registered trademark). The communication I / F 703 is connected to a mobile phone line (for example, LTE (Long Term Evolution), PHS (Personal Handy-phone System) The interface may be a wireless communication interface such as a cellular phone (cellular phone) or a cellular phone (cellular phone).

[0100] The control circuit 702 communicates with an external device via the communication I / F 703, For example, various information including image information related to the image to be projected is acquired from the external device. In addition, each time the control circuit 702 obtains various information from an external device, The acquired information is stored in memory, and the contents of the memory are updated based on the acquired information. Or you can do that.

[0101] The GPS receiver 704 identifies the current location of the image projection device 200. Specifically, 4 is, for example, a GPS antenna, an RF (Radio Frequency ) section, baseband section, etc. The GPS antenna receives the radio waves broadcast by the GPS satellites. The RF section restores the unmodulated signal received by the GPS antenna to a baseband signal. The baseband unit modulates the baseband signal demodulated by the RF unit to generate a signal for the image projection device. The GPS receiver 704 further calculates the current position of the GPS receiver 200 by filtering the GPS signal. Filters, LNAs (Low Noise Amplifiers), and power amplifiers (PAs) The device may also include an amplifier such as a power amplifier.

[0102] The current position of the image projection device 200 is determined based on radio waves transmitted from multiple GPS satellites. The baseband section can determine the distance to each of the four GPS satellites. Positioning is performed by calculating the distances and then calculating the position where each of the distances intersect. Based on the radio waves received from the GPS satellite, the geometric relationship between the GPS satellite and the image projection device 200 is Instead of GPS to find position, Michibiki, GLONASS, and Galileo The current location of the image projection device 200 is identified using a satellite positioning system such as ALILEO. This is also fine.

[0103] The motor 705 is controlled by the control circuit 702 and rotates to generate a propeller. Specifically, the motor 705 has a rotor made of a permanent magnet. This makes it possible to use a brushless motor in which the stator is formed by a coil. The number of motors 705 can be the same as the number of propellers 605. The propellers 605 are rotated independently to move the image projection device 200 forward or backward. It can also be rotated left and right.

[0104] If a driving mechanism for adjusting the attitude of the projector 601 or the camera 603 is provided, The control circuit 702 also controls the operation of the motors 705 that each of these drive mechanisms has. As a result, the image projection device 200 can project the projector 601 and the camera 603 while moving. The posture of each can be adjusted independently (individually).

[0105] As described above, the projector 601 converts light emitted from the projector light source into a and irradiates the light outside the projector 601 via the projection lens 601a. By doing so, the projector 601 projects an image at the location where the light is irradiated. The intensity of the light emitted from the projector light source is adjusted according to the distance from the position where the image is projected. The image quality of the projected image may be adjusted by adjusting the projector 60. The distance between the image projector 1 and the position where the image is projected can be determined, for example, by using a distance sensor. The distance sensor can be, for example, a laser distance sensor, an ultrasonic sensor, an infrared sensor, or the like. Various known sensors such as a line sensor can be used.

[0106] The camera 603 is equipped with an image sensor, and converts light received by the image sensor through a photographing lens into an electrical signal. The generated image information (photographed data) is The signal is output to the control circuit 702. The camera 603 may be a camera for taking still images. The camera may be capable of capturing video. A video is a series of still images captured at a predetermined time interval. Image information is reproduced according to the standard format of the compression method for specified video and audio data (e.g. For example, MPEG (Moving Picture Experts Group) ) may be compressed.

[0107] The human presence sensor 604 emits an electric current in response to temperature changes caused by infrared light absorption by the light receiving element. The human sensor 604 outputs a signal to the control circuit 702. Specifically, the human sensor 604, for example, A current signal corresponding to a temperature change is converted into a voltage signal and amplified, and the amplified voltage signal is amplified when the amplified voltage signal exceeds a predetermined threshold. When the value is exceeded, a predetermined electrical signal is output to the control circuit 702. When the input of a predetermined electrical signal output from the human sensor 604 is received, Detect The 201.

[0108] The microphone 706 collects sounds around the image projection device 200. The voice input as log data is converted into an electrical signal. The analog audio signal input as analog data is converted to digital and Generates audio data in .tar format.

[0109] The speaker 707 generates sound by vibrating a diaphragm with an electric signal, which is an audio signal. The speaker 707 may be an output terminal that outputs an audio signal. An external speaker may be connected to the output terminal to generate sound.

[0110] The image projection device 200 also notifies the status of the image projection device 200, although not shown in the figure. and keys or buttons for inputting instructions to the image projection device 200. The input / output device may include an input / output device for inputting other information processing devices. It may be realized by a connectable connection terminal or the like.

[0111] In addition, the image projection device 200 is connected to the image projection device 200 via a card slot. The memory card I / F may be an interface for connecting the memory card to the storage device. It is responsible for the interface between the memory card and the internal memory, and inputs data from the memory card. and controls the output of data to the memory card. The image to be projected is stored on a memory card, and the image can be projected by simply replacing the memory card. The image projected by 200 can be switched.

[0112] (An example of a functional configuration of the image projection device 200) Next, an example of the functional configuration of the image projection device 200 will be described. 8 is a block diagram showing an example of a functional configuration of the device 200. The image projection device 200 according to this embodiment has the following functions: a user instruction receiving unit 801 and a projection target A user identification unit 802, a body part information acquisition unit 803, a projection image information acquisition unit 804, and a body A body part identification unit 805, a projection position / projection size determination unit 806, a warning output unit 807, and a movement A position and projection angle determination unit 808, a movement and projection angle control unit 809, and an image information projection unit 810 This is realized by the projection image capturing unit 811 and the instruction output unit 812. These components 801 to 812 realize the function of the control unit of the image projection device 200. This can be done.

[0113] The user instruction receiving unit 801 receives an instruction from the user 201 to project image information. The projection instruction reception unit 802 outputs the received projection instruction to the projection target user identification unit 802. Specifically, the unit 801 includes, for example, the camera 603, the microphone 706, and the The function can be realized by the control circuit 702 and the communication I / F 703 shown in FIG. The user instruction receiving unit 801 can receive an instruction to end the projection. Then, the image information projection unit 810 outputs an instruction to end the projection.

[0114] The user instruction receiving unit 801 receives various operation instructions for the projected image information. The received instructions can be output from the instruction output unit 812 to the outside (transmit ) It should be noted that all or part of the various instructions from the user can be transmitted to the image projection device 2. It is also possible to send the information directly to the outside without going through 00.

[0115] The projection target user specification unit 802 receives a projection instruction from the user instruction receiving unit 801. Specifically, the projection target user identification unit 802 identifies the projection target user by, for example, 7, the camera 603, the microphone 706, the control circuit 702, and the communication I / F 7 The projection target user specification unit 802 can realize this function by the following: In this way, the projection target user is identified.

[0116] In the case of a user-dedicated image projection device 200, the user's information (the information transmitted by the user) is stored in advance. The system stores the user's ID information or information identified from the user's physical characteristics. Based on the information, the user's current location is identified. The user's location is captured at regular time intervals. And if the user moves, their location is captured.

[0117] In the case of a shared image projection device, the device receives user information and, based on that information, The user 201 is searched for. The search for the user 201 is performed by, for example, searching for a user message sent by the user 201. The location of the user 201 is calculated based on the user ID signal. The search for the user 201 may be based on information related to the morphological characteristics of the user 201. The image captured by the camera 603 is analyzed to identify the corresponding user 201. If the current location of the user 201 can be found, The current location of the user 201 is identified and grasped at regular time intervals. If 01 moves, its position is captured.

[0118] The projection target user identification unit 802 is configured to identify the projection target user 201 by storing information about the identified projection target user 201, In addition, the position information of the user is output to the body part identification unit 805.

[0119] The body part information acquisition unit 803 acquires information relating to the body part that will be the screen on which the image information is projected. Specifically, the body part information acquisition unit 803 acquires information, for example, the body part information shown in FIG. The function can be realized by the camera 603, the microphone 706, and the communication I / F 703. When a body part is designated by the user 201, the body part information acquisition unit 803 The designated information is acquired using the camera 603, the microphone 706, the communication I / F 703, etc. The body part information acquisition section 803 outputs the acquired body part information to the body part identification section 805.

[0120] The projection image information acquisition unit 804 acquires image information to be projected. Specifically, the function of the communication I / F 703 shown in FIG. The projection image information may be a still image or a video. Image information also includes information about the content (profile) of the image. The type of message (e.g. chat or video call), the resolution of the image, and the amount of data. The shadow image information acquisition unit 804 outputs the acquired image information to the image information projection unit 810. The acquired image information is then input to the body part identification unit 805 and the input unit 806. The result is output to the shadow position / projection dimension determination unit 806.

[0121] The body part identification unit 805 is a projection target user identified by the projection target user identification unit 802. information about the user, and information about the body part acquired by the body part information acquisition unit 803 Then, the body part that will be the screen onto which the image information is projected is identified. Furthermore, the projected image information is acquired. The image content information obtained by the unit 804 is used to identify a body part. For example, if the image is relatively large, the user 201 may specify the palm of his / her hand. Even if you have a body part, you can change it to an arm. In that case, you can also change the designated body part. The body part identification unit 805 can also notify (project) the user of the body part. For example, the camera 603 and the motion sensor 604 shown in FIG. 6 and FIG. 7, and the control device shown in FIG. The function can be realized by a circuit 702 or the like.

[0122] Specifically, the body part identification unit 805 identifies a body part as follows. When the position is palm, if there is an instruction to project image information, the user who knows the position will first The position of the palm of the user's hand is identified by the image projection device 200. The image captured by the camera 603 is analyzed. As a reference or as a supplement to the camera, a human presence sensor 604 such as an infrared sensor is used. Specifically, the position of each part of the user's body, head, shoulders, etc. may be specified. ,The direction and posture of the user are identified from the arm, etc., and the position of the user's palm is estimated. do.

[0123] Then, the position of the palm is grasped based on the shape of the palm. Physical characteristics (finger length, fingerprints, palm lines, veins, etc.) confirm that it is the palm of the user may be authenticated.

[0124] In this way, the body part identification unit 805 identifies the body part (palm). Each of the body parts can be identified based on its respective characteristics. The projection position and projection size determination unit 805 outputs information about the identified body part to the projection position and projection size determination unit 806.

[0125] The projection position and projection size determination unit 806 determines the position of the body part specified by the body part specification unit 805. Based on the position, the projection position for projecting the image information and the size of the projected image are determined. The image information acquired by the shadow image information acquisition unit 804 is referred to, and based on the content, The projection position for projecting the image information and the size of the projected image may be determined based on the projection position. Specifically, the projection position / projection size determination unit 806 is, for example, a control circuit 70 shown in FIG. This function can be realized by 2.

[0126] Specifically, the projection position and projection size determination unit 806 determines the position and size of the body part identified by the body part identification unit 805. Based on information regarding the position of the palm of the user 201 on the selected body part, the direction of the fingers The projection position and projection direction may be determined based on the orientation of the body, the angle of the wrist, etc. Regarding the palm of the user 201 that is placed on the body part identified by the part identification unit 805 From the information, the size of the palm is determined, and the image is projected so that it fits on the palm. The size of the image information to be displayed may be determined.

[0127] In addition, the projection position and projection size determination unit 806 determines the position of the body part identified by the body part identification unit 805. The projection method for projecting the image may be changed based on the state of the body part. Specifically, the state of the part is, for example, whether or not the part is wearing gloves. 6 outputs information regarding the determined projection position, projection dimensions, etc. to the movement position and projection angle determination unit. do.

[0128] In addition, the projection position and projection size determination unit 806 determines the palm of the hand based on the finger direction, wrist angle, etc. If it is determined that projection is not possible, a warning output unit 807 is notified of the fact that projection is not possible. The device outputs information prompting the user to change the position of their palm.

[0129] The warning output unit 807 outputs a warning when the projection position and projection size determination unit 806 determines the projection position and projection size. When determining the location of the body part, if projection is not possible on the body part identified by the body part identification unit 805, In such a case, a warning will be displayed to the user urging them to move their position or the position of their body part. Specifically, the warning output unit 807 outputs a warning to the communication I / F 703 shown in FIG. This function can be realized by a speaker 707 or the like.

[0130] The moving position and projection angle determination unit 808 determines the position and projection dimension determined by the projection position and projection dimension determination unit 806. Based on the projection position and projection dimension, the moving position of the image projection device 200 and the image projection size are adjusted. The moving position / projection angle determining unit 80 determines at least one of the projection angle and the moving position determining unit 80. Specifically, the function of the control circuit 702 shown in FIG. Specifically, the moving position / projection angle determination unit 808 determines the latitude of the moving position. The longitude information and the projection angle of the projector 601 are calculated, and the calculation result is used to control the movement and projection angle. The data is output to the control unit 809.

[0131] The movement / projection angle control unit 809 determines the position and projection angle determined by the movement position / projection angle determination unit 808. Based on the movement position of the image projection device 200, the motor 705 is controlled to move the image projection device 200. In addition, the movement position and projection angle of the image projection device 200 determined by the movement position and projection angle determination unit 808 is The projection angle of the image projection device 200 is adjusted based on the moving position. Specifically, the control circuit 702, the GPS receiver 704, the motor 709, and the like shown in FIG. The function can be realized by the controller 705 or the like.

[0132] The image information projection unit 810 projects the image information acquired by the projection image information acquisition unit 804. The selected body part is projected as a screen. In response to the received instruction to end the projection, the projection of the image information may be stopped. Specifically, the image information projection unit 810 is, for example, the projector 6 shown in FIG. 01, can be realized by the control circuit 702 shown in FIG.

[0133] The projection image capturing unit 811 captures an image projected onto an arbitrary body part as a screen. The projection image capturing unit 811 captures or acquires the surroundings of the image. For example, the camera 603 and the motion sensor 604 shown in FIG. 6 and FIG. The projection image capturing unit 811 captures the captured image or the acquired image. Information relating to the surrounding conditions of the image is output to a projection position / projection size determination unit 806 .

[0134] The projection position and projection dimension determination unit 806 determines, based on the acquired surrounding conditions of the arbitrary part, The projection method for projecting an image is changed, and information related to the changed projection method is input to the image information projection unit 81. 0. The surrounding situation of an arbitrary part may be specifically, If the surroundings are relatively bright, try to increase the illuminance of the projected image. On the other hand, when the surroundings are relatively dark, such as at night, the illuminance of the projected image is reduced. This is also fine.

[0135] The projection position and projection size determination unit 806 determines the image captured by the projection image capture unit 811. The projection method may be changed based on the recognized image conditions. Specifically, the quality of the projected image may be degraded, or the user 201 may not be able to see the image. If it becomes difficult to see, change the projection position or dimensions to improve visibility. Then, information related to the changed projection method may be output to the image information projection unit 810. Alternatively, the input may be forced to the input terminal.

[0136] The instruction output unit 812 outputs the instruction received by the user instruction receiving unit 801 to the image being projected. The instruction output unit 812 outputs information related to the instruction of the user 201 with respect to the image information. Specifically, the function can be realized by, for example, the communication I / F 703 shown in FIG. Also, information regarding instructions can be transmitted to each component via the bus 700. This is also fine.

[0137] (An example of a processing procedure of the image projection device 200) Next, an example of a processing procedure of the image projection device 200 will be described. 9 is a flowchart showing an example of a processing procedure of the device 200. First, the image projection device 200 identifies the current position of the projection target user to which image information is to be projected. (Step S901).

[0138] Next, among the identified body parts of the projection target user, the body parts to which the image information is to be projected are selected. Then, based on the acquired information on the body part, Based on this, the current position and orientation of the body part to be projected is specified (step S903). Then, based on the position and orientation of the identified body part, the body part in that position and orientation is It is then determined whether or not it is possible to project image information onto the target object (step S904).

[0139] In step S904, if it is determined that projection is not possible (step S904: N o) issues a warning to the projection target user that projection is not possible (step S90 5) This allows the user to move their position, change the position of their body part, etc. Then, the process returns to step S901, and steps S901 to S90 Repeat the process of step 5.

[0140] In step S904, if it is determined that projection is possible (step S904: Y es) determines the projection position and projection dimensions of the image information to be projected (step S906). Then, the projection position and projection size of the image information thus determined are used to determine the projection position and projection size of the image projection device 200. The position is determined (step S907).

[0141] Next, the image projection device (own device) 200 is moved to the determined projection position, and the projection angle After the movement and adjustment are completed, the (identified) body part is screened. Then, the image information is projected as a projection (step S909).

[0142] Then, it is determined whether the position and orientation of the body part to be projected have changed (step S 910) The judgment of whether the position or orientation of the projected body part has changed can be done, for example, by 8, the body part information identification unit 803 performs identification at predetermined intervals (for example, every 0.5 seconds). The difference between the information on the location of the body part identified last time (e.g. 0.5 seconds ago) Here, the position and orientation of the projected body part are changed. If it is determined that the number of the inputs has been reached (step S910: Yes), the process returns to step S903 and the inputs are input again. The position and orientation of the body part that is being imaged are identified (step S903), and thereafter, steps S904 and onward The following processing is carried out.

[0143] In step S910, if it is determined that the position and orientation of the body part to be projected have not been changed, If the decision is rejected (step S910: No), next, whether the body part to be projected has been changed or not is checked. It is determined whether the body part to be projected has been changed (step S911). For example, the judgment is based on the information acquired by the body part information acquisition unit 803 shown in FIG. If the body part to be projected is changed (step S911 If the answer is "Yes", the process returns to step S902 and the information on the body part to which the image information is to be projected is again input. The information is acquired (step S902), and thereafter, the processes from step S903 onwards are carried out.

[0144] In step S911, if the body part to be projected has not been changed (step S 911: No), it is then determined whether the projection target user has moved (step S9 12) The judgment of whether the projection target user has moved or not can be done, for example, by The user identification unit 802 performs identification at predetermined time intervals (for example, 0.5 seconds) and The decision is based on the difference between the information about the location of the user to be projected and the information about the location of the user identified 0.5 seconds ago. Here, if the projection target user moves (step S91 2: Yes), the process returns to step S901, and the current position of the projection target user is identified again ( Step S901), and then the processes from step S902 onwards are carried out.

[0145] In step S912, if the projection target user has not moved (step S912 Next, it is determined whether or not an instruction to end the projection has been issued (step S913). The determination as to whether or not a projection end instruction has been received is made based on, for example, a projection end instruction received from the user instruction receiving unit 801. If there is no instruction to end the projection, If the answer is NO (step S913: No), the process proceeds to step S910. The respective processes of S913 are repeated. On the other hand, if an instruction to end the projection is given (step S If the user selects the image display device 100 (YES in step S913), the projection of the image information is stopped (step S914), and the series of processes is terminated. do.

[0146] In this way, the image projection device 200 projects an image onto any part of the body of the user 201. In addition, if the position or orientation of a body part changes, or if the body part to be projected changes, Even if the part is changed or the user 201 moves, the image can be continuously projected. You can cast shadows.

[0147] <Another embodiment> Although the drone projector 200 has been described as an image projection device, The device is not limited to this. For example, an image projection device that is movable on an indoor wall or ceiling may be used. The inventor calls this image projection device a "movable projector." The company named it the "Moveable Projector (abbreviated as Movable Projector)." The projection direction can be changed, and the projector itself can be moved on walls and ceilings.

[0148] FIG. 10 is a diagram showing an image projection device (movable projector) according to another embodiment of the present invention. FIG. 10 is an explanatory diagram showing an example of a moving environment of the image projection device 1000 and the image projection device 1000. In this embodiment, the same parts as those of the image projection device 200 according to the above embodiment are the same. As shown in FIG. 10, an image projection device (movable projector) 1 1000 includes a moving body 1001. The moving body 1001 includes a main body 1002, a rolling body 1003, and a 003, a magnet 1004, and a slide shoe 1005.

[0149] The main body 1002 is substantially box-shaped, and contains the control circuit 702, an antenna, a motor, a battery, and the like. The control circuit 702 is composed of a CPU, memory, etc., and controls the image. The driving control unit 1003 drives and controls each unit of the image projection device 1000. The motor 705 connected to the projection lens 3 is driven and controlled to rotate the rolling element 1003, thereby projecting the image. Move position 1000.

[0150] The rolling body 1003 is connected to the main body 1002 so as to be capable of rotating (rolling). The body 1003 protrudes from the end face of the main body 1002 toward the ceiling 1006 or wall 1007. It is preferable that three or more rolling elements 1003 are provided. The device 1000 can be moved stably and smoothly.

[0151] Specifically, the rolling element 1003 is realized by, for example, a roller, a ball, or a roller. By implementing the rolling body 1003 using balls or rollers, the moving body The turning radius of the 1001 can be reduced, making it easier to maneuver and more flexible to move around. When the rolling element 1003 is realized by a roller, the toe angle and Adjust the caster angle accordingly.

[0152] The magnet 1004 is provided on the same side of the main body 1002 as the rolling element 1003. The magnet 1004 attracts the image projection device 600 to a ceiling 1006 or a wall 1007 by magnetic force. The slide shoe 1005 has a sheet or plate shape. 005 is a magnet 1004 that attracts the image projection device 1000 to a ceiling 1006 or a wall 1007. The magnetic field is not lost and the image projection device 600 is not resisted by the material. Specifically, the slide shoe 1005 is formed of, for example, hard silicone rubber. It can be formed using the above.

[0153] The end face of the slide shoe 1005 opposite to the main body is the tip of the rolling element 1003 (rolling element The position of the contact point between the ceiling 1006 and the wall 1007 and the position of the contact point 1003 is the same as or slightly different from the position of the contact point between the ceiling 1006 and the wall 1007 and the contact point 1003. The rolling element 1003 is provided at a position on the side of the ceiling 1. 1006 or a wall 1007, the image projection device 600 can be moved smoothly. It is possible to do so.

[0154] The slide shoe 1005 can be moved toward and away from the magnet 1004 or the main body 1002. Specifically, for example, the slide shoe 1005 may be provided on the magnet 10. 04 or the main body 1002 may be connected via an elastic member such as a spring. This allows the rolling element 1003 to be in contact with the ceiling 1006 or the wall 1007 reliably. This allows the image projection device 600 to be moved smoothly.

[0155] Such an image projection device 1000 uses the GPS receiver 704 as described above to determine the current position. The image projection device 1000 may specify a position, but is not limited to this. Used in PHS (Personal Handy-phone System) etc. The current position may be identified using the principle of triangulation. A plurality of PHS base stations (not shown) are provided on the wall 1007 and the like. The position of the device is identified by receiving the transmitted radio waves via an antenna.

[0156] As a result, the presence of the ceiling 1006 and the wall 1007 makes it difficult to receive radio waves from GPS satellites. Even in a difficult environment, the position of the image projection device 1000 can be identified and controlled with high accuracy. This allows the image 502 to be projected at any position within the building. The image projection device 1000 can be moved along the ceiling 1006 and the wall 1007, so that the user can This reliably prevents collisions between the user 201 and the vehicle, thereby ensuring the safety of the user 201.

[0157] In this way, the image projection device 1000 can be moved using indoor facilities. The equipment inside the building may be at least one of the indoor walls, ceilings, and floors. The image projection device 1000 can be moved along the indoor facilities. By this, the image projection device 1000 can be moved to a desired position indoors, and the user 201 can An image can be reliably projected onto the desired location.

[0158] In addition, as yet another embodiment, the image projection device may be configured as follows. For example, the projector may be attached to the body of the user 201. Rechargeable projectors are built into glasses or hats, or can be attached to them. It is being done.

[0159] Other types of portable information terminal devices (such as smartphones) that can be held and operated with one hand In this case, the projector may be a portable information terminal device owned by the user. The portable information terminal device may be a portable information terminal device owned by a person other than the user.

[0160] As described above, the image projection method according to the embodiment of the present invention is and the position of any part (e.g., reference numerals 101, 102, etc.) of the body of the user 201. The user identifies the identified arbitrary parts as screens 110, 120, 400, and 500. The device projects an image transmitted or distributed to the camera 201. Since the user can use their body as a screen, they do not need to carry a display device such as a mobile terminal device. Even if you don't have a monitor or screen nearby, you can still see the image. You can see it.

[0161] In addition, the image projection method according to the embodiment of the present invention further includes: The image projection device 200 or 1000 that projects the image is moved to a position where the image can be projected. This allows the image to be reliably projected onto the desired part of the user 201. It is possible.

[0162] In addition, the image projection method according to the embodiment of the present invention is a method for projecting an image using an unmanned aerial vehicle (UAV) equipped with an image projection device (200). The robot 602 moves the robot around, allowing it to fly freely in three-dimensional space. In addition, the image projection device 200 can be moved to a desired position.

[0163] In addition, the image projection method according to the embodiment of the present invention is configured such that the image projection device 1000 is installed indoors. The feature is that the indoor equipment is moved using the indoor wall, ceiling, and and at least one of the floor and the image projection device 1000 along the indoor facilities. In this way, the image projection device can be moved to a desired position indoors. 1000 and project an image onto any desired part of the user 201. can be done.

[0164] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The present invention is characterized in that any part of the user 201 can be set by designation by the user 201. This allows the user 201 to project an image at a desired position and view the image. can be done.

[0165] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The feature of this method is that any part of the camera 201 is selected based on the content of the image. Then, the most suitable part of the user 201 for the image is set as the screen. This makes it possible to improve the visibility of the image.

[0166] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The projection method for projecting an image is changed based on the state of any part of the screen 201. This allows us to know the state of any part of the body, specifically, for example, the palm of the hand, It can recognize differences such as whether you are wearing gloves or not, and change the projection method accordingly. This allows for more optimal projection and improves the visibility of the image.

[0167] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The method of projecting an image can be changed based on the surrounding conditions of any part of the device. This makes it possible to know the surrounding conditions of an arbitrary part, specifically, the surrounding brightness, for example. It can recognize differences in lighting, such as the density of people, and change the projection method accordingly, This allows for optimal projection and improves the visibility of the image.

[0168] In addition, the image projection method according to the embodiment of the present invention includes the steps of: It can recognize the image projected on the screen and change the projection method based on the recognized image conditions. This allows the projected image to be captured, the captured image to be analyzed, and Based on the analysis results, the projection method can be changed to correct the projected image, resulting in a more optimal projection. This makes it possible to improve the visibility of the image.

[0169] In addition, the image projection method according to the embodiment of the present invention includes the steps of: The arbitrary part of the user 201 that is the target is the body of the user 201. It is characterized by being a visible part. For example, the screen is The intended part is the hand or arm of the user 201. By simply moving it, it can be easily used as a screen, allowing you to project images more quickly. Cut.

[0170] In addition, for example, any part of the user 201 that becomes the screen may be the leg of the user 201. In this way, for example, when the user 201 is sitting, In addition, the legs or feet are easier to see the projected image than the hands or arms. The cleaning area is relatively large, allowing for large projection of images.

[0171] Also, for example, an arbitrary part of the user 201 that serves as a screen may be a part of the hand of the user 201. The screen is made of a finger or toenail. Using bright and shiny nails allows the image to be projected more clearly.

[0172] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. Any part of the user 201 is a part of the body of the user 201 that the user 201 sees using a mirror. This allows the user 201 to see his / her own body reflected in the mirror. You can use the mirror as a screen, and you can see the image content at the same time as looking in the mirror. Cut.

[0173] In addition, the image projection method according to the embodiment of the present invention further includes the step of: When an image is projected onto a portion that is visible through the lens, the image is inverted from left to right. This prevents the image information from being inverted and difficult to read, even if the image information is text. This can eliminate the feeling of discomfort.

[0174] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The arbitrary part of the user 201 is characterized in that it is the face, head, or neck of the user 201. This allows the user 201 to check the content of the image while looking at his or her own face in the mirror. can be done.

[0175] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. The arbitrary part of the user 201 is characterized in that the arbitrary part of the user 201 is the trunk or buttocks of the user 201. This allows the user 201 to check the content of the image while looking at his or her whole body in the mirror. can be done.

[0176] In addition, the image projection method according to the embodiment of the present invention is a method for projecting an image of a user 201 and the user The position of 201 arbitrary body parts was identified, and the clothes on the identified arbitrary parts were screened. The present invention is characterized in that it projects an image transmitted or distributed to a user 201 as an application. For example, clothing may include at least one of clothing, gloves, shoes, socks, hats, and masks. This allows the user 201 to use their clothes as a screen. Therefore, even if you do not have a display device such as a mobile terminal device, or if you have a display This allows users to view images even if there is no display device such as a monitor or screen nearby.

[0177] In the image projection method according to the embodiment of the present invention, a user interface that serves as a screen is further provided. A projection method for projecting an image based on the type or state of clothing on any part of the camera 201. For example, the method of changing the position of the screen of the user 201 can be used. A projection device that projects an image based on at least one of the color and material of the clothing in This allows the system to recognize differences in the color and material of clothing, and The projection method can be changed according to the difference in the image, realizing more optimal projection and improving the visibility of the image. It is possible.

[0178] In addition, the image projection devices 200 and 1000 according to the embodiments of the present invention are And the position of an arbitrary part of the body of the user 201 is specified, and the specified arbitrary part is screened. A control unit (controller) projects an image transmitted or distributed to a user 201 as a screen. This allows the user 201 to move his / her body in a screen. Therefore, even if you do not have a display device such as a mobile terminal device, You can see images even if you are not around a display device such as a monitor or screen. Cut.

[0179] In addition, the image projection devices 200 and 1000 according to the embodiments of the present invention are And the position of an arbitrary part of the body of the user 201 is specified, and the arbitrary part is The clothes worn by the user are sent or distributed to the user 201 as a screen. The device is characterized by having a control unit (control circuit 702) that projects the image received from the projector. This allows the user 201 to use his / her clothes as a screen, so that the user can easily use a mobile terminal device, etc. Even if you don't have a display device, or if you have a display device such as a display or screen, You can see the images even if you are not nearby.

[0180] Moreover, the image projection apparatus 200 and 1000 according to the embodiment of the present invention further include a control The control circuit 702 controls the image projector 701 to project the image onto a desired location. The image projection devices 200 and 1000 are moved. Therefore, an image can be reliably projected onto any desired part of the body.

[0181] In addition, the unmanned aerial vehicle 602 according to the embodiment of the present invention is The position of an arbitrary part of the body of the user 201 is specified, and the specified arbitrary part is used as a screen. The projector 202 projects an image transmitted or distributed to the user 201. The unmanned aerial vehicle 602 according to the embodiment of the present invention is a vehicle for controlling a user 201 and a user 20 The position of an arbitrary part of the body of 1 is identified, and the clothes at the identified arbitrary part are used as a screen. and projects the image transmitted or distributed to the user 201. 02). Furthermore, the unmanned aerial vehicle 6 according to the embodiment of the present invention is 02 is characterized by moving to a position where an image can be projected onto any part of the body and projecting the image. do.

[0182] This allows the robot to fly freely in three-dimensional space, move to any desired location, and project images. The user 201 can use his / her body or clothes as a screen, so it is possible to Even if you don't have a display device such as a terminal device, or if you have a display or screen, Images can be viewed even if no display device is present nearby.

[0183] In addition, the image projection program according to the embodiment of the present invention is The position of an arbitrary part of the body of the user 201 is specified, and the specified arbitrary part is used as a screen. The image projection device projects the image transmitted or distributed to the user 201. The image projection program according to the embodiment of the present invention is characterized in that it executes the image projection program. identifies the position of the user 201 and any part of the body of the user 201, and The image is transmitted or distributed to the user 201 using the clothes at any part of the body as a screen. The present invention is characterized in that the image projection device executes a process of projecting the image. The image projection program according to the embodiment of the present invention is for projecting an image onto the image projection device 200 or 1000. A process of moving an image projection device that projects the image to a position where the image can be projected on an arbitrary part. The present invention is characterized in that it causes the program to be executed.

[0184] This allows the image projection devices 200 and 1000 to be moved to desired positions to project images. The user 201 can use his / her body or clothes as a screen. Even if you do not have a display device such as a mobile terminal device, or if you have a display or screen, This allows users to view images even if there is no display device such as a monitor nearby.

[0185] The image projection method described in this embodiment uses a program prepared in advance. By running it on a computer such as a personal computer or workstation This program can be used on hard disks, CD-ROMs, MOs, DV It is recorded on a computer-readable recording medium such as a USB memory or SSD, and The program is executed by reading it from the recording medium by a computer. A program is a transmission medium that can be distributed over a network such as the Internet. It is also possible. [Industrial Applicability]

[0186] As described above, the image projection method, the image projection device, the unmanned aerial vehicle, and the image projection method according to the present invention The projection program includes an image projection method for projecting an image, an image projection device, an unmanned aerial vehicle, and an image projection method. It is useful for projection programs, especially for image projection methods that use the body as a screen to project images. The present invention is suitable for the imaging method, image projection device, unmanned aerial vehicle and image projection program. [Explanation of symbols]

[0187] 110, 120 Palmtop Screen 200 Image projection device (drone projector) 201 users 400 Arm Top Screen 500 List Top Screen 601 Projector 602 Drone 603 Camera 604 Human Sensor 801 User Instructions Reception Department 802 Projection target user identification unit 803 Body part information acquisition unit 804 Projection image information acquisition unit 805 Body part identification section 806 Projection position and projection size determination unit 807 Warning Output Unit 808 Movement position / projection angle determination unit 809 Movement and projection angle control unit 810 Image information projection unit 811 Projection image capture unit 812 Instruction output unit 1000 Image projection device (movable projector)

Claims

1. Identifying the location of a user and any part of the user's body; The specified arbitrary portion is used as a screen, and the image is transmitted or distributed to the user. and projecting the image.

2. An image projection device for projecting the image is moved to a position where the image can be projected onto the arbitrary portion.

2. The image projection method according to claim 1, further comprising the step of: moving the image projection surface relative to the light source.

3. 3. The image projection device according to claim 2, wherein the image projection device is moved by an unmanned aerial vehicle. Image projection method.

4. 3. The image projection device according to claim 2, wherein the image projection device is moved using an indoor facility. Image projection method.

5. The indoor equipment is at least one of an indoor wall, a ceiling, and a floor, 5. The image projection device according to claim 4, wherein the image projection device is moved along an indoor facility. Image projection method.

6. The arbitrary part of the user that becomes the screen is set by the user's designation.

6. The image projection method according to claim 1, further comprising:

7. The arbitrary part of the user that becomes the screen is selected based on the content of the image.

6. The image projection method according to claim 1, further comprising:

8. The image is projected based on the state of the arbitrary part of the user that serves as the screen.

8. The image projection method according to claim 1, wherein the projection method is changed. method.

9. The image is generated based on the surroundings of the arbitrary part of the user that serves as the screen.

9. The image display device according to claim 1, wherein a projection method for projecting the image is changed. Image projection method.

10. 10. The method according to claim 9, wherein the surrounding situation of the arbitrary portion is the brightness of the surrounding area. The image projection method described herein.

11. The image projected on the screen is recognized, and a projection direction is determined based on the recognized image condition.

11. The image projection method according to claim 1, further comprising changing a method for projecting an image.

12. The arbitrary part of the user that becomes the screen is the body of the user. The display device according to any one of claims 1 to 11, characterized in that the display device is a part that is visible to a user. Image projection method.

13. The arbitrary part of the user that serves as the screen is the user's hand or arm.

13. The image projection method according to claim 12.

14. The arbitrary part of the user that becomes the screen is the leg or foot of the user.

13. The image projection method according to claim 12.

15. The arbitrary part of the user that becomes the screen is a finger or a toe of the user.

13. The image projection method according to claim 12, characterized in that the image is a fingernail.

16. The arbitrary part of the user that becomes the screen is the body of the user.

12. The part according to claim 1, which is a part that can be visually recognized by a user using a mirror. The image projection method according to any one of claims 1 to 5.

17. When the image is projected onto a part that can be seen by the user using a mirror, the left and right sides of the image 17. The image projection method according to claim 16, further comprising the step of inverting the image.

18. The arbitrary part of the user that becomes the screen is the face, head, or neck of the user.

17. The image projection method according to claim 16, further comprising:

19. The arbitrary part of the user that becomes the screen is the trunk or buttocks of the user.

17. The image projection method according to claim 12, wherein

20. Identifying the location of a user and any part of the user's body; The clothes at the specified arbitrary part are used as a screen to transmit or receive the image to the user. and projecting a broadcasted image.

21. The clothing includes at least one of clothes, gloves, shoes, socks, a hat, and a mask.

21. The image projection method according to claim 20, further comprising:

22. Based on the type or state of clothing worn on the arbitrary part of the user that serves as the screen 22. The projection method for projecting the image is changed based on the above-mentioned.

2. The image projection method according to claim 1 .

23. The color and material of the clothing of the user at the arbitrary part serving as the screen are reduced. The projection method for projecting the image is changed based on at least one of the above.

22. The image projection method according to claim 20 or 21,

24. Identifying the location of a user and any part of the user's body; The specified arbitrary portion is used as a screen, and the image is transmitted or distributed to the user. projecting the image, An image projection device comprising a control unit.

25. Identifying the location of a user and any part of the user's body; The clothes at the specified arbitrary part are used as a screen to transmit or receive the image to the user. or projecting a broadcasted image; An image projection device comprising a control unit.

26. The control unit is An image projection device for projecting the image is moved to a position where the image can be projected onto the arbitrary portion.

26. The image projection device according to claim 25, wherein the projection device is adapted to move the projection surface.

27. Identifying the location of a user and any part of the user's body; The specified arbitrary portion is used as a screen, and the image is transmitted or distributed to the user. An unmanned aerial vehicle characterized by projecting an image.

28. Identifying the location of a user and any part of the user's body; The clothes at the specified arbitrary part are used as a screen to transmit or receive the image to the user.

23. An unmanned aerial vehicle characterized by projecting an image or a broadcast image.

29. The image is moved to a position where it can be projected onto the arbitrary part, and the image is projected.

29. An unmanned aerial vehicle as claimed in claim 27 or 28.

30. Identifying the location of a user and any part of the user's body; The specified arbitrary portion is used as a screen, and the image is transmitted or distributed to the user. The process of projecting the image is An image projection program that is executed by an image projection device.

31. Identifying the location of a user and any part of the user's body; The clothes at the specified arbitrary part are used as a screen to transmit or receive the image to the user. or a process of projecting the delivered image, An image projection program that is executed by an image projection device.

32. The image projection device projects the image at a position where the image can be projected onto the arbitrary portion.

31. The image projection device according to claim 30, further comprising:

32. The image projection program according to claim 31.

Images