Mobile projection device and program for mobile projection device

Abstract

To provide a mobile projection device that enables a viewer to receive projection images that are easy to view and sounds with a proper volume.SOLUTION: The mobile projection device includes: an aerial flight mechanism for flying in the air; a projector unit for projecting images; a camera for capturing images of viewers viewing the projected images; a speaker for releasing sounds related with the images; a head count detection unit for detecting the number of viewers based on the images captured by the camera; and a control unit for controlling the volume of the sounds released from the speaker according to the number of viewers detected by the head count detection unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a mobile projection device and a program for the mobile projection device. [Background technology]

[0002] For example, Patent Document 1 (JP Patent Publication 2007-229855A) proposes an autonomous mobile robot that moves along with a specific person and can project and display image information related to the area around the moving point on an appropriate projection surface. According to the invention of Patent Document 1, image information such as advertisements and warnings related to the current location of a moving person can be displayed to the moving person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-229855 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the autonomous mobile robot of the invention of Patent Document 1 must accompany a specific person when moving. Originally, a user only needed to have a projection image projected when and where they needed, so the accompanying of the autonomous mobile robot itself was troublesome, and the user had to move while considering the movement route for the accompanying movement of the autonomous mobile robot, which was troublesome.

[0005] Moreover, the autonomous mobile robot of the invention of Patent Document 1 uses the head or back of a specific person or the road surface as a projection surface. Therefore, when there are multiple viewers, it is difficult for the multiple viewers to simultaneously view the projection image. In particular, when there are many viewers, for example, a person at the back may not be able to view the projection image because the person in front gets in the way.

[0006] SUMMARY OF THE PRESENTING EMBODIMENT An object of the present invention is to provide a mobile projection device that can solve the above problems. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides: an aerial flight mechanism for flying in the air; a projector unit for projecting an image; a speaker that outputs a sound related to the image; a camera for photographing a viewer viewing the projected image; a number-of-viewers detection unit that detects the number of viewers from the captured image of the camera; a control unit that controls a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection unit; A communication means for receiving call information; Equipped with 、 Based on information for specifying a location included in the call information, the projector moves to a location near a viewer who is in a place where the call information is transmitted, and projects the image by the projector unit. The present invention provides a mobile projection device.

[0008] The mobile projection device according to the present invention includes an aerial flight mechanism and can fly through the air to travel, so that it can fly to a desired location when needed and provide a projection image to a viewer at that location using the projector unit provided there.

[0009] The mobile projection device according to the present invention detects the number of viewers from the image captured by the camera, and controls the volume of the sound related to the image to be emitted from the speaker according to the detected number of viewers. Effect of the Invention

[0010] According to the projection device of the present invention, the volume of the sound related to the projected image that is emitted from the speaker is controlled according to the number of viewers, so that the viewers can hear the sound at an appropriate volume. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram for explaining an example of the configuration of a first embodiment of a mobile projection device according to the present invention. [Diagram 2] 1 is a block diagram for explaining an example of the configuration of a drive control device of a first embodiment of a mobile projection device according to the present invention. [Diagram 3] FIG. 2 is a diagram showing a part of a flowchart for explaining an example of a processing operation of the first embodiment of the mobile projection device according to the present invention. [Figure 4] FIG. 2 is a diagram showing a part of a flowchart for explaining an example of a processing operation of the first embodiment of the mobile projection device according to the present invention. [Diagram 5] 1 is a diagram showing an example of a usage mode of a first embodiment of a mobile projection device according to the present invention. [Figure 6] FIG. 11 is a diagram for explaining a configuration example of a second embodiment of a mobile projection device according to the present invention. [Figure 7] 11 is a diagram showing an example of a usage mode of a mobile projection device according to a second embodiment of the present invention. FIG. [Figure 8] FIG. 13 is a diagram for explaining a configuration example of a third embodiment of a mobile projection device according to the present invention. [Figure 9] FIG. 13 is a diagram for explaining a configuration example of a third embodiment of a mobile projection device according to the present invention. [Figure 10] FIG. 13 is a diagram showing an example of a usage mode of a mobile projection device according to a fourth embodiment of the present invention. [Figure 11] FIG. 13 is a block diagram for explaining an example of the configuration of a drive control device of a mobile projection device according to a fourth embodiment of the present invention. [Figure 12] FIG. 13 is a diagram showing a part of a flowchart for explaining an example of a processing operation of a mobile projection device according to a fourth embodiment of the present invention. [Figure 13] FIG. 13 is a diagram showing a part of a flowchart for explaining an example of a processing operation of a mobile projection device according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [First embodiment] Fig. 1 is a diagram showing a configuration example of a first embodiment of a mobile projection device according to the present invention. The mobile projection device 1 of the embodiment of the present invention is configured to be capable of autonomously flying and moving in the air. Fig. 1(A) is a diagram showing the mobile projection device 1 of this embodiment as seen from above, and Fig. 1(B) is a diagram showing the mobile projection device 1 of this embodiment as seen from the front.

[0013] The mobile projection device 1 of this embodiment includes a flight mechanism 2 having a so-called quadcopter structure, and a drive control unit 3. The flight mechanism 2 is driven and controlled by the drive control unit 3. As shown in Fig. 1, the flight mechanism 2 is configured by attaching rotor mechanisms 5A, 5B, 5C, and 5D to the tips of four arms 4A, 4B, 4C, and 4D extending from the drive control unit 3.

[0014] The rotor mechanisms 5A, 5B, 5C, and 5D are configured to rotate the rotors 52A, 52B, 52C, and 52D by rotating the rotor shafts (not shown) using the motor drivers 51A, 51B, 51C, and 51D, respectively. The motor drivers 51A, 51B, 51C, and 51D have their rotation speed and direction controlled by a drive control signal from the drive control unit 3. The motor drivers 51A, 51B, 51C, and 51D and the drive control unit 3 use a battery (not shown) as a power source for rotation drive and a power source for drive control. The camera, microphone, various sensors, displays, and control units described later are also supplied with power from the battery. The projector described later is also supplied with power from the battery. For example, a rechargeable secondary battery is used as the battery. A solar cell can also be used. When a solar cell is installed, there is an advantage that the mobile projection device 1 can fly while charging with sunlight during the day outdoors.

[0015] In this example, each of the motor driving units 51A, 51B, 51C, and 51D is independently controlled by a drive control signal from the drive control unit 3, thereby enabling the mobile projection device 1 to perform various movement operations such as takeoff, landing, ascent (straight up, diagonally upward), descent (straight down, diagonally downward), right turn, left turn, forward movement, backward movement, right shift, and left shift, as well as attitude control such as the tilt angle relative to the vertical direction and position control of the hovering position.

[0016] In the mobile projection device 1 of this embodiment, a camera, a microphone, various sensors, etc., which will be described later, are attached integrally with the drive control unit 3, and a housing 6 that houses a drive control device section 10 including a control section is formed. In this example, the housing 6 is configured to have an overall box-like shape.

[0017] Two legs 7A, 7B are attached to the housing 6 so as to face each other. In this example, the legs 7A, 7B are made of pipe members formed into a trapezoidal shape, and are formed so as to stably hold the mobile projection device 1 on the landing surface 8 as shown in FIG. 1(B). The shape and material of the legs are not limited to this, and various shapes and materials are possible. For example, the legs may be made of wood or metal material and have four cylindrical legs at the four corners of the housing 6. Also, movable wheels may be attached to the legs to facilitate movement on the landing surface 8.

[0018] Above the rotors 52A, 52B, 52C, and 52D, in a position that does not interfere with the rotation of the rotors 52A, 52B, 52C, and 52D, the projector 9 is fixed to a support base 92 supported by a support pillar 91 that stands upright from the upper surface of the drive control unit 3 portion of the housing 6. A remote control transmission unit 93 for remotely controlling the projector 9 is attached to the support base 92. The remote control transmission unit 93 is attached to the support base 92 at a position where a remote control receiving unit (not shown) of the projector 9 can receive a remote control signal.

[0019] The projector 9 in this example includes a playback unit (not shown) for a DVD (Digital Versatile Disc) as an example of a storage medium. The projector 9 has a function of playing back image information stored on a DVD loaded in the playback unit and projecting the image information as a projection image. 9L is a lens for projecting the projection image. The playback sound of audio information stored in the DVD in association with the image information is emitted from speakers 9SL and 9SR included in the projector 9.

[0020] A DVD stores a plurality of pieces of image information and audio information that are prepared in advance to be provided to a viewer. Each of the pieces of image information and audio information can be cue-adjusted by a remote control signal.

[0021] In the following description, the surface side on which the projection lens 9L of the projector 9 is provided is defined as the front side of the mobile projection device 1.

[0022] In this example, as shown in Figures 1(A) and (B), a camera CM1 and a microphone MC are provided on the front of the housing 6. A speaker SP is also provided on the front of the housing 6. As shown in Figures 1(A) and (B), cameras CM2 and CM3 are provided on the left and right sides of the housing 6, respectively, and a camera CM4 is provided on the rear of the housing 6. Furthermore, a camera CM5 is provided on the bottom of the housing 6, as shown in Figure 1(B).

[0023] The optical axes (corresponding to the shooting direction) of the cameras CM1 to CM5 are in a direction perpendicular to the mounting surfaces of the cameras CM1 to CM5, and each camera can shoot a predetermined angle of view with the optical axis direction as the center.

[0024] A drive control device section 10 is provided inside the housing 6. Fig. 2 is a block diagram showing an example of the configuration of the drive control device section 10 in the mobile projection device 1 of this embodiment. Note that a battery is omitted in Fig. 2.

[0025] As shown in FIG. 2, the drive control device unit 10 in this embodiment is configured by connecting, via a system bus 100, a control unit 101 consisting of a computer, an aerial flight drive unit 102, a gyro sensor 103, a geomagnetic sensor 104, an altitude sensor 105, an obstacle sensor 106, a movement space information memory 107, a current position detection unit 108, a flight drive signal generation unit 109, a position and attitude control signal generation unit 110, a group of cameras 111, a guidance message memory 112, an image recognition unit 113, a voice interface unit 114, a voice recognition unit 115, a projection image list memory 116, a projector remote control interface 117, and a remote control signal generation unit 118.

[0026] A microphone MC and a speaker SP are connected to the audio interface unit 114. Furthermore, the projector remote control interface 117 is connected to the remote control transmission unit 93.

[0027] The aerial flight drive unit 102 supplies drive control signals to each of the motor drive units 51A, 51B, 51C, and 51D of the rotary wing mechanisms 5A, 5B, 5C, and 5D of the aerial flight mechanism unit 2 under the control of the control unit 101.

[0028] The gyro sensor 103 detects changes in acceleration during flight of the mobile projection device 1, and is used to detect the flight direction, speed, and attitude of the mobile projection device 1. The geomagnetic sensor 104 is used to detect the direction in which the mobile projection device 1 is flying. The altitude sensor 105 detects the altitude at which the mobile projection device 1 is located at a given time, and is made up of, for example, a barometric sensor.

[0029] The obstacle sensor 106 detects the presence of an obstacle by emitting light, infrared rays, millimeter waves, quasi-millimeter waves, microwaves, ultrasonic waves, or the like and detecting the reflected waves from the obstacle, and also detects the time and attenuation between emitting light, infrared rays, or ultrasonic waves and receiving the reflected waves, and is capable of calculating the distance to the detected obstacle from the time and attenuation. In this embodiment, the obstacle sensor 106 is used to detect obstacles in the space in which the mobile projection device 1 is used (hereinafter referred to as the moving space), such as indoor walls, chests of drawers, beds, desks, and the like, and obstacles in the outdoor moving space, such as utility poles, buildings, trees, and the like, and is used to fly while avoiding collisions with them.

[0030] The moving space information memory 107 stores spatial information related to indoor and outdoor moving spaces in which the mobile projection device 1 is used. Examples of indoor moving spaces include art galleries, museums, and stores. Examples of outdoor moving spaces include limited-range spaces such as theme parks, amusement parks, zoos, concert venues, soccer stadiums, and baseball fields. Of course, the space is not limited to a limited range, and the spatial information is stored in the moving space information memory 107 as a moving space as long as it is within the flight range of the mobile projection device 1, such as around a company, around a station, or around an airport.

[0031] In this embodiment, the control unit 101 of the mobile projection device 1 stores an application program for panoramic photography (e.g., Photosynth) in the memory, and the mobile projection device 1 flies within the moving space and captures images in a 360-degree range at each location within the moving space using all or some of the cameras CM1 to CM5 in advance. Then, the control unit 101 uses the application program for panoramic photography to generate 3D image information at each point within the moving space from the captured image information, and stores the generated 3D image information in the moving space information memory 107.

[0032] In this case, in this example, the mobile projection device 1 defines a specific location in the moving space in which it is used as a home position, and uses that location as a base for takeoff and landing. The specific location may be defined as a charging station, which is a normal waiting location.

[0033] The information stored in the moving space information memory 107 also includes position information of the determined home position. When the moving space is indoors, information on the length, width, and height of the room to be used is also stored in advance in the moving space information memory 107. Furthermore, when the moving space is indoors, structural information of the room to be used, such as beams, pipe spaces, and pillars, may also be stored in advance, and when the moving space is outdoors, the positions of utility poles, buildings, and trees may also be stored in advance.

[0034] The moving space information memory 107 also stores in advance the locations (position information) of indoor walls and outdoor building walls onto which the projector 9 can project a projection image, together with the length x width x height information of the walls. A screen onto which the projection image is to be projected may be provided in advance indoors or outdoors, and the position of the screen may be stored in the moving space information memory 107.

[0035] Also, in facilities such as kindergartens and nursery schools that mainly cater to children, instructions to project at a lower position according to the height of the children can be input to the moving space information memory 107. In facilities such as nursing homes for the elderly and hospitals where many people use wheelchairs, instructions to project at a lower position can also be input to the moving space information memory 107.

[0036] The current position detection unit 108 includes, for example, a GPS (Global Positioning System) receiver, and detects the latitude, longitude, and altitude of the current position of the mobile projection device 1. In order to obtain more accurate position information, the current position may be detected using radio waves from a mobile phone base station or radio waves from an access point of Wi-Fi (Wireless Fidelity (registered trademark)) communication. In addition, the current position detection unit 108 may detect the current position by capturing a relative position in the 3D image space by using all or some of the cameras CM1 to CM5 to capture an image of the surroundings of the mobile projection device 1 and comparing the captured image information with the 3D image information stored in the moving space information memory 107 for image recognition. In order to detect the current position after movement, the current position detection unit 108 also uses the gyro sensor 103, the geomagnetic sensor 104, and the altitude sensor 105.

[0037] When the control unit 101 issues a command based on startup information to start flying from the base (home position) and move through the air, the flight drive signal generation unit 109 calculates the direction and distance of movement from the base position information stored in the movement space information memory 107 and the current position information detected by the current position detection unit 108 to generate a flight drive signal for movement.

[0038] Then, the flight drive signal generation unit 109 generates a flight drive signal for moving from the base position to a position instructed by the control unit 101 based on the calculated direction and distance, using information from the gyro sensor 103, the geomagnetic sensor 104, the altitude sensor 105, etc., and further referring to the images captured by the cameras CM1 to CM5 of the camera group 111, and supplies the flight drive signal to the aerial flight mechanism unit 2 through the aerial flight drive unit 102. In this case, the flight drive signal is composed of signals for driving the motor drive units 51A to 51D of the four rotary wing mechanisms 5A to 5D, respectively. The generated flight drive signal is supplied to the motor drive units 51A to 51D of the aerial flight mechanism unit 2 through the aerial flight drive unit 102, respectively.

[0039] Upon receiving this flight drive signal, the aerial flight mechanism unit 2 drives and rotates each of the rotors 52A to 52D to move by aerial flight from the base to a position instructed by the control unit 101, or from the current position to the base.

[0040] Based on the gyro sensor 103, the geomagnetic sensor 104, the altitude sensor 105, and the images captured by the cameras CM1 to CM5, the position and orientation control signal generation unit 110 generates a position and orientation control signal that controls the position and orientation of the device relative to the projection surface at the location where the determined projection image is to be projected so that the orientation and position are appropriate (whether the optical axis of the lens 9L of the projector 9 is perpendicular to the wall surface onto which the projection image is projected, whether the front-back and left-right positions are appropriate, and whether the up-down position (height position) is appropriate, etc.).

[0041] In the mobile projection device 1 of this embodiment, as described later, the control unit 101 determines the location where the projection image is to be projected depending on the number of viewers. Note that the concept of the location where the projection image is to be projected includes the concept of different locations such as different wall surfaces, as well as different positions on the same wall surface (positions that differ in the left-right direction or positions that differ in the height direction).

[0042] Then, when the location where the projection image is to be projected is determined, the control unit 101 controls the flight drive signal generation unit 109 to generate a flight drive signal for hovering at the position (including the height position) where the projection image is to be projected at the determined location where the projection image is to be projected, and supplies this to the aerial flight mechanism unit 2 via the aerial flight drive unit 102. Then, the position and attitude control signal generation unit 110 generates a signal for controlling the height position for hovering.

[0043] In a hovering state, the mobile projection device 1 projects and displays a projection image by the projector 9 at the determined location. If there is a space available for landing, such as a desk, at a location suitable for projecting a projection image by the projector 9 at the determined location, the mobile projection device 1 may land at that location and project the projection image by the projector 9 at the determined location. After projection, the mobile projection device 1 may determine the surrounding situation, move up, down, left, or right from the determined location, adjust the location, or change the location itself. For example, if the viewer seems to have difficulty seeing, the mobile projection device 1 may move to a location where it is easier to see.

[0044] The camera group 111 is made up of the above-mentioned cameras CM1 to CM5. Each of the cameras CM1 to CM5 outputs captured image information of a moving image to the system bus 100. Identification information for identifying which camera the captured image information is from is added to the captured image information sent from each of the cameras CM1 to CM5 to the system bus 100. Note that the captured image information from each of the cameras CM1 to CM5 may not be captured image information of a moving image, but may be captured image information of still images taken at a predetermined time interval, for example, at 0.5 second intervals.

[0045] The guidance message memory 112 stores guidance messages such as information about the service in which the mobile projection device 1 provides projection images, guidance about images to be projected by the service, and the possibility of selecting an image.

[0046] The image recognition unit 113 recognizes people and the number of people from the captured image information captured by the cameras CM1 to CM5. The image recognition unit 113 also recognizes obstacles to be avoided during flight as described above. The image recognition unit 113 recognizes people and the number of people and recognizes obstacles by performing pattern matching processing on the captured image information based on comparison images for detecting people and images of obstacles stored in an image memory (not shown). The flight drive signal generation unit 109 generates a flight drive signal for moving through the air while avoiding the recognized obstacles.

[0047] In this embodiment, the image recognition unit 113 is also used to search for locations such as indoor walls and outdoor building walls onto which a projection image can be projected by the projector 9, which are stored in the movement space information memory 107, from images of the surrounding environment captured by the cameras CM1 to CM5.

[0048] The audio interface unit 114 has a function of supplying an audio signal collected by the microphone MC to the audio recognition unit 115. The audio interface unit 114 also has a function of emitting audio for transmitting a guidance message audio to the viewer from the speaker SP in accordance with the control of the control unit 101. The microphone MC may be an omnidirectional microphone, but may also be a directional microphone in order to collect only the audio uttered by the viewer.

[0049] The projection image list memory 116 stores a list of projection image information consisting of text information (e.g., title) indicating the contents of the image information stored on the DVD loaded in the projector 9, its playback order number, and the start and end points of the recording addresses on the DVD.

[0050] The DVD stores text information (e.g., titles) indicating the contents of the image information stored on the DVD stored in the projection image list memory 116, and image information of a list of the playback order numbers, and the projection images of the list are provided to the viewer.

[0051] The voice guidance message stored in the guidance message memory 112 includes an explanation and guidance about the projection images in the list, and also includes a guide message for indicating a desired projection image from the list by its playback order number.

[0052] As will be described later, the control unit 101 receives a voice command for the playback order number of a desired projection image from the viewer through the microphone MC, and recognizes the voice in the voice recognition unit 115 to recognize the commanded playback order number. Then, the control unit 101 supplies a remote control signal from the remote control transmission unit 93 to the projector 9 so as to provide the projection image of the recognized playback order number as a projection image from the projector 9.

[0053] The projector remote control interface 117 is connected to the remote control transmission unit 93. The remote control signal generation unit 118 stores a remote control signal for a DVD, and the control unit 101 calls up a remote control signal for the projector 9 from the remote control signal generation unit 118 and sends it to the remote control transmission unit 93 via the projector remote control interface 117, so that the signal is transmitted to the remote control reception unit of the projector 9.

[0054] In addition, in FIG. 2, the processing functions of the flight drive signal generation unit 109, the position and attitude control signal generation unit 110, the image recognition unit 113, and the voice recognition unit 115 can also be realized by the control unit 101 as software processing functions.

[0055] [Operation flow of the mobile projection device 1 according to the first embodiment] 3 and 4 are flowcharts showing an example of the flow of operations of the mobile projection device 1 of the first embodiment. In the following explanation, the control unit 101 will be described assuming that the control unit 101 realizes the processing functions of the flight drive signal generation unit 109, the position and attitude control signal generation unit 110, the image recognition unit 113, and the voice recognition unit 115 as software processing functions.

[0056] First, the control unit 101 sets the mobile projection device 1 in a standby state at the home position (step S101). In this standby state, the control unit 101 captures the visible range with the cameras CM1 to CM5, performs image recognition on the captured images, and monitors visitors to a museum, theme park, or the like where the mobile projection device 1 is installed.

[0057] Then, the control unit 101 determines whether or not a visitor has been detected based on the image recognition results of the images captured by the cameras CM1 to CM5 (step S102), and if a visitor has not been detected, the process returns to step S101 and maintains the standby state.

[0058] When a visitor is detected in step S102, the control unit 101 flies and moves to the vicinity of the detected visitor (step S103). Then, the control unit 101 confirms the number of viewers detected or detected from the image recognition results of the images captured by the cameras CM1 to CM5 (step S104).

[0059] Next, the control unit 101 determines whether or not there is a suitable location near the visitors to project the projection image for the detected number of visitors based on the image recognition results of the images captured by the cameras CM1 to CM5 and the stored information in the moving space information memory 107 (step S105). If it is determined in step S105 that there is no suitable location near the visitors to project the projection image for the number of visitors, a guide message voice is emitted from the speaker SP to guide the visitors to an appropriate location based on the stored information in the moving space information memory 107, and the visitors are guided to the appropriate location (step S106). Note that the guidance method is not limited to voice, and the mobile projection device 1 can be equipped with lights such as LEDs (not shown) and guided by turning on or blinking the lights.

[0060] When it is determined in step S105 that a suitable location for projecting a projection image for the number of visitors is near the visitors, and after guiding the visitors to the suitable location in step S106, the control unit 101 determines a suitable projection location and projection position according to the number of visitors, and a suitable screen size of the projection image according to the number of visitors (step S107).Then, the control unit 101 controls the projector 9 to project a projection image with the determined screen size at the projection position of the determined projection location, and controls the speaker SP to emit a guide message voice about the projected projection image (step S108).

[0061] At this time, the speakers 9SL and 9SR of the projector 9 emit sounds associated with the projection image, and the control unit 101 transmits a remote control signal to the projector 9 to cause the speakers 9SL and 9SR to emit sounds at a volume according to the number of viewers who have determined the screen size of the projection image. That is, the volume of the sounds from the speakers 9SL and 9SR is set to a relatively low volume when the number of viewers is small and the screen size of the projection image is small, and is set to a high volume according to the screen size when there are many viewers and the screen size is large. This allows the volume of the sounds from the speakers 9SL and 9SR to be controlled to an appropriate volume according to the number of viewers.

[0062] Next, the control unit 101 monitors the voice recognition result of the voice picked up by the microphone MC, and determines whether or not a desired voice from the viewer viewing the projected projection image is detected (step S111 in FIG. 4). If it is determined in this step S111 that a desired voice from the viewer is detected, the control unit 101 sends a remote control signal to the projector 9 to change the projection image to a projection image according to the viewer's request (step S112).

[0063] Then, when it is determined in step S111 that no request voice from the viewers is detected, or after the projection image to be projected is changed in step S112, the control unit 101 determines whether the number of viewers has changed (step S113). When it is determined in this step S113 that the number of viewers has changed, the control unit 101 determines whether the projection location and / or screen size needs to be changed (step S114), and when it is determined that a change is necessary, the process returns to step S103, and the process from step S103 onwards is repeated. Note that various determination criteria can be set in step S114. For example, it is possible to set the screen size to be increased when the number of viewers increases, but not to be decreased when the number of viewers decreases. In addition, since frequent changes in the projection location and screen size can be tiring, it is also possible to limit the number of changes and the time for which the changes can be made.

[0064] If it is determined in step S113 that the number of viewers has not changed, or if it is determined in step S114 that there is no need to change the projection location and / or screen size, the control unit 101 determines whether to end the projection image provision service based on whether all of the image information stored on the DVD has been projected or whether a voice requesting termination from a viewer has been recognized (step S115).

[0065] If it is determined in step S115 that the service of providing the projection image is not to be ended, the control unit 101 returns the process to step S108 and repeats the processes from step S108 onwards. Also, if it is determined in step S115 that the service of providing the projection image is to be ended, the control unit 101 sends a remote control signal of end to the projector 9, and then flies back to the waiting place (step S116), returns the process to step S101 and goes into a waiting state.

[0066] [Example of Usage of the Mobile Projection Device 1 of the First Embodiment] Next, an example of a usage mode of the mobile projection device 1 of the above-mentioned first embodiment is shown in Fig. 5. The example of Fig. 5(A) shows a case where there is one visitor, and the example of Fig. 5(B) shows a case where there are many visitors.

[0067] As shown in Fig. 5(A), when there is one visitor HM, the control unit 101 of the mobile projection device 1 of this embodiment determines the projection location to be a position near the visitor HM and at a height position that is approximately the same as the eye level of the visitor HM so that the visitor HM can easily view, and determines the screen size to be a screen size that allows one viewer to see the entire screen at a glance. In the example of Fig. 5(A), the projection location is a location PS1 on the wall surface WL near the viewer HM and at the height of the viewer HM's eye level, which is the determined screen size portion.

[0068] The control unit 101 of the mobile projection device 1 then moves the device to the determined height position, controls it to hover at that height position, and controls the projector 9 by a remote control signal to change the screen size to the determined screen size through a combination of zoom processing by the lens 9L and the projection distance. As a result, a projection image Pj1 of the determined screen size is projected and displayed at the location PS1 on the wall surface WL.

[0069] Furthermore, when there are many visitors HM as shown in Fig. 5(B), the control unit 101 of the mobile projection device 1 takes into consideration that the viewers will be lined up in front of and behind the projection location PS, and determines the projection location to be a position higher (above) than the horizontal line of sight of the viewers so that viewers at the back can also view the image, and determines the screen size to be larger than when there is only one person or a small number of people. In the example of Fig. 5(B), the projection location is a height position on the wall surface WL at which the many viewers HM look up, and is set to the location PS2 of the determined screen size.

[0070] Then, the control unit 101 of the mobile projection device 1 moves the device itself to the determined height position, controls the device itself to hover at that height position, and controls the projector 9 by a remote control signal to set the screen size to the determined size through a combination of zoom processing by the lens 9L and the projection distance. As a result, a projection image Pj2 of the determined screen size is projected and displayed at the location PS2 on the wall surface WL.

[0071] Although there is only one viewer at the start of projection of the projection image, when the number of viewers increases, the projection location (projection position) and / or screen size is controlled to change in accordance with the increase in viewers, as explained in the flowchart above.

[0072] In this case, if the wall surface WL has an area corresponding to the upper part and a wide screen size as the projection location of the projection image, as in the wall surface WL in the example of Fig. 5, a different position on the same wall surface WL can be determined as the projection location. However, as described above, if an appropriate area cannot be secured on the same wall surface WL as the projection location, it is necessary to move the projection location to another wall surface where an appropriate projection location can be secured. In this case, the control unit 101 of the mobile projection device 1 of this embodiment guides and guides the viewer about the movement by a guide message voice, as described in the above flow chart.

[0073] [Second embodiment] In the above-mentioned first embodiment, the projection location (including different positions on the same wall) and the screen size of the projection image are changed according to the number of viewers, but the number of screens of the projection image to be projected may be changed. The second embodiment is an example of a case where the number of screens of the projection image to be projected is changed according to the number of viewers, and is an example of a case where the number of screens can be changed between one and two.

[0074] Fig. 6 is a front view of the mobile projection device 1AB of the second embodiment, which corresponds to Fig. 1(B) of the first embodiment. A view of the mobile projection device 1AB of the second embodiment from above is similar to Fig. 1(A). In the mobile projection device 1AB of the second embodiment shown in Fig. 6, the same parts as those in the mobile projection device 1 of the first embodiment described above are given the same reference numerals, and their description will be omitted.

[0075] As shown in Fig. 6, the mobile projection device 1AB of the second embodiment is fixed to a support base 92AB supported by a support column 91AB erected from the upper surface of the housing 6 at the drive control unit 3 portion. A projector 9A and a projector 9B are attached to the support base 92AB so as to be arranged in two stages, one above the other. Remote control transmission units 93A and 93B for remotely controlling the projectors 9A and 9B attached to the support base 92AB are attached to the support base 92AB. The remote control transmission units 93A and 93B are attached to the support base 92AB at positions where the remote control receiving units (not shown) of the projectors 9A and 9B can receive remote control signals. The rest of the configuration is the same as that of the first embodiment.

[0076] Although not shown, the drive control device section of the mobile projection device 1AB of the second embodiment has almost the same configuration as that of the first embodiment shown in Fig. 2. However, the remote control transmission sections 93A and 93B are different from the configuration in Fig. 2 in that they are connected to the control section 101 via projector remote control interfaces.

[0077] In the mobile projection device 1AB of the second embodiment, when there is one or a small number of viewers (even if there are multiple rows, the number of viewers is such that viewers in the front rows do not get in the way of the viewers), one projection image PjA (see FIG. 7) is projected by the lower projector 9A. When there are many viewers (even if there are multiple rows, the number of viewers in the front rows does not get in the way of the viewers), as shown in FIG. 7, a projection image PjB is projected not only by the lower projector 9A but also by the upper projector 9B. This allows viewers in the rear to view the projection image PjB projected by the upper projector 9B without getting in the way of the viewers in the front rows.

[0078] It goes without saying that the screen size of the projection image can be changed in the mobile projection device 1AB of the second embodiment as well. In this case, the screen size of the projection image PjA by the projector 9A on the lower stage and the screen size of the projection image PjB by the projector 9B on the upper stage can be changed independently.

[0079] In the second embodiment described above, the two projectors 9A and 9B face the same optical axis direction, but they may be arranged so that their optical axes face different directions. For example, one projector may be installed so that its optical axis direction faces the front direction, while the other projector may be installed so that its optical axis direction faces upward (toward the ceiling) perpendicular to the front direction, or in the left-right direction.

[0080] Although the second embodiment described above uses two projectors, the number of projectors may be three or more. For example, the projectors may be installed in three tiers: top, middle, and bottom.

[0081] [Third embodiment] The third embodiment is another example of the case where the number of screens for projecting a projection image is changed according to the number of viewers, and the number of screens can be changed between one and three.

[0082] Fig. 8 is a front view of the mobile projection device 1CDE of the third embodiment, and corresponds to Fig. 1(B) of the first embodiment. A view of the mobile projection device 1CDE of the third embodiment from above is omitted. In the mobile projection device 1CDE of the third embodiment shown in Fig. 8, the same parts as those in the mobile projection device 1 of the first embodiment described above are given the same reference numerals, and their description is omitted.

[0083] As shown in Fig. 6, the mobile projection device 1CDE of the third embodiment is fixed to a support base 92CDE supported by a support column 91CDE erected from the upper surface of the drive control unit 3 portion of the housing 6. Three projectors, 9C, 9D, and 9E, are attached to the support base 92CDE so that they are arranged side by side on the same plane of the support base 92CDE. Of course, the arrangement and attachment methods are not limited to this. For example, they do not have to be attached on the same plane, and they do not have to be arranged side by side.

[0084] Remote control transmitters 93C, 93D, and 93E are attached to the support base 92CDE to remotely control the projectors 9C, 9D, and 9E that are arranged side by side and attached to the support base 92CDE. The remote control transmitters 93C, 93D, and 93E are attached to the support base 92CDE at positions where the remote control receivers (not shown) of the projectors 9C, 9D, and 9E can receive remote control signals. The rest of the configuration is the same as that of the first embodiment.

[0085] Although not shown, the drive control device section of the mobile projection device 1CDE of the third embodiment has almost the same configuration as that of the first embodiment shown in Fig. 2. However, the remote control transmission sections 93C, 93D, and 93E are different from the configuration in Fig. 2 in that they are each connected to the control section 101 via a projector remote control interface.

[0086] In the mobile projection device 1CDE of the third embodiment, when there is one or a small number of viewers and they are relatively concentrated in one place, the central projector 9C projects the projection image PjC. When there are many viewers and they are scattered all over the place, as shown in Fig. 9, a two-screen display using the projection image PjC by the central projector 9C and one of the projection images PjD and PjE by the projectors 9D and 9E on both sides of the central projector 9C, or a three-screen display using the projection image PjC by the central projector 9C and both of the projection images PjD and PjE by the projectors 9D and 9E on both sides of the central projector 9C, is used. The control unit 101 determines whether to use two screens or three screens based on the image recognition results of the images captured by the cameras CM1 to CM5, depending not only on the number of viewers but also on their concentration (scattering).

[0087] This allows all viewers to view the image satisfactorily with two or three projection images, even when the viewers are in multiple groups, each group concentrating and therefore scattered as a whole, or when the viewers are composed of a single person or multiple couples and are scattered, etc. Furthermore, in addition to image recognition of the captured image, the line of sight of each viewer may be detected to grasp the viewer's concentration (dispersion) and consider the screen composition.

[0088] It goes without saying that the screen sizes of the projection images PjC, PjD, and PjE can be changed in the mobile projection device 1CDE of the third embodiment as well. In that case, it goes without saying that each of the projection images PjC, PjD, and PjE can be changed independently.

[0089] In the third embodiment, the three projectors 9C, 9D, and 9E are oriented in the same optical axis direction, but they may be arranged so that their optical axes are oriented in different directions. For example, one projector may be installed so that its optical axis direction is in the front direction, while the other two projectors may be installed so that their optical axes direction is in the upward direction (toward the ceiling) perpendicular to the front direction, or in the left-right direction.

[0090] Furthermore, in the above-described third embodiment, an example was given in which three projectors were used, but the number of projectors may be two or four or more.

[0091] Furthermore, two projectors, one above the other as in the second embodiment, may be installed on the left and the right.

[0092] [Fourth embodiment] In the above-mentioned embodiment, the mobile projection device waits at a position where it can see the visitors, and when it detects a visitor, it flies to the side of the detected visitor and provides a projection image. In the fourth embodiment described below, in response to a call from a viewer, it detects the location of the viewer who made the call, moves to that location, and provides a projection image.

[0093] A mobile projection device according to a fourth embodiment described below has a configuration that takes into consideration the case where the viewer is a foreigner.

[0094] Before describing an example of the configuration of the mobile projection device of the fourth embodiment, an example of the environment in which the mobile projection device of the fourth embodiment is used will be described with reference to FIG.

[0095] The example of Fig. 10 is a case where the mobile projection device 1F of the fourth embodiment is assumed to provide various kinds of guidance in a museum by projecting images. The museum in this example has a plurality of exhibition spaces separated by walls. That is, as shown in Fig. 10, the museum in this example has a plurality of exhibition spaces consisting of a Western painting space 201, a Japanese painting space 202, a calligraphy and painting space 203, a sculpture space 204, a special exhibition space 205, and a pottery space 206, as well as an entrance hall 207. Visitors can purchase tickets at an outside ticket booth 208 and present the tickets at a gate 209 to enter the entrance hall 207 through the gate 209.

[0096] A standby base 210 for the mobile projection apparatus is provided in the entrance hall 207, and a plurality of the mobile projection apparatus 1F of the fourth embodiment are configured to wait at this standby base 210. Of course, the mobile projection apparatus 1F may be configured to wait for one apparatus, or two or more apparatuses, for example, 100 or more apparatuses, may be configured to wait.

[0097] Call posts 211, 212, 213, 214, 215, 216, and 217 are installed in each of the Western painting space 201, Japanese painting space 202, calligraphy space 203, sculpture space 204, special exhibition space 205, and pottery space 206, as well as the entrance hall 207, through which visitors can send call signals to call the mobile projection device 1F of the fourth embodiment.

[0098] Call posts 211, 212, 213, 214, 215, 216, and 217 are each equipped with a call button 211BT, 212BT, 213BT, 214BT, 215BT, 216BT, and 217BT. When a visitor (viewer) presses a call button 211BT, 212BT, 213BT, 214BT, 215BT, 216BT, or 217BT, the call post equipped with the pressed call button transmits a call signal including identification information for identifying itself.

[0099] As described later, the mobile projection device 1F includes a communication unit that receives call signals from the call posts 211-217. The mobile projection device 1F recognizes which call post the call signal is from based on identification information included in the received call signal, and flies to the side of a visitor (hereinafter, referred to as a viewer) in the space where the recognized call post is installed, to provide a projection image. In this example, the call posts 211-217 and the multiple mobile projection devices 1F are connected by a wireless LAN conforming to the Wi-Fi (registered trademark) standard.

[0100] Next, a configuration example of a mobile projection device 1F of a fourth embodiment will be described. The mobile projection device 1F of the fourth embodiment described below is mechanically configured in the same manner as the mobile projection device 1 of the first embodiment equipped with one projector. The mobile projection device 1F of the fourth embodiment has a partly different configuration of a drive control device unit from the mobile projection device 1 of the first embodiment. In the following description of the mobile projection device 1F of the fourth embodiment, the same parts as those of the first embodiment are given the same reference symbols, and detailed description thereof will be omitted.

[0101] 11 is a block diagram showing an example of the configuration of a drive control device unit 10F of a mobile projection device 1F of the fourth embodiment. As shown in this Fig. 11, the drive control device unit 10F includes a communication unit 121 and a foreign language determination unit 122.

[0102] The communication unit 121 has a wireless communication function for performing communication for the wireless LAN described above. When the communication unit 121 receives a call signal from any of the call posts 211 to 217, the communication unit 121 extracts the identification information of the call post contained in the received signal and sends it to the control unit 101 via the system bus 100.

[0103] The movement space information memory 107 of this drive control device unit 10F stores movement space information consisting of the multiple exhibition spaces 201-206 and entrance hall 207 of the art museum shown in Figure 10, as well as correspondence information between the identification information and position information of each of the call posts 211-217 installed in the exhibition spaces 201-206 and the entrance hall 207, respectively.

[0104] When the control unit 101 receives the identification information of the call post from the communication unit 121, it determines whether the call signal was received from the exhibition space 201-206 or the entrance hall 207 based on the corresponding information between the identification information and the position information of the call post 211-217 stored in the moving space information memory 107. Then, the control unit 101 causes the flight drive signal generation unit 109 to generate a flight drive signal for flying to either the exhibition space 201-206 or the entrance hall 207 where the recognized call post is located, and controls the aerial flight mechanism unit 2 to execute the flight movement. The control unit 101 of the mobile projection device 1F that has received the call signal and started moving in response to the call controls the communication unit 121 to a sleep state or a stop state so as not to receive other call signals from the start of movement until the return to the standby base 210.

[0105] When the foreign language determination unit 122 moves close to the viewer to provide a projection image, it determines which language is being used if the viewer is a foreigner, based on the voice recognition result by the voice recognition unit 115 for the voice signal picked up by the microphone MC.

[0106] The DVD loaded into the mobile projection device 1F of the fourth embodiment stores not only image information and audio information in Japanese, but also image information and audio information of the same program content in, for example, English, Spanish, French, German, Chinese, and Korean, associated with identification information of the language used. Note that, as the program content, image information and audio information of guidance to be provided to viewers in each of the exhibition spaces 201-206 and the entrance hall 207 are stored in association with identification information of the exhibition spaces 201-206 and the entrance hall 207.

[0107] When it is determined that the language used by the viewer is a foreign language other than Japanese but does not match any of the prepared languages, the viewer is asked to select the language to be provided, and the information is provided in the selected language.

[0108] In the mobile projection device 1F of this fourth embodiment, the projection image list memory 116 stores identification information for the image information and audio information of the guidance to be provided to viewers in each of the exhibition spaces 201-206 and the entrance hall 207, and correspondence information between the address information on the DVD and the identification information for each of the image information and audio information corresponding to a plurality of languages ​​used, for image information and audio information of the same program content, and correspondence information between the storage addresses on the DVD and the identification information for each of the image information and audio information.

[0109] The rest of the configuration is the same as each unit of the drive control device unit 10 of the mobile projection device 1 of the first embodiment shown in Fig. 2. The processing function of the foreign language determination unit 122 can be realized by the control unit 101 as a software processing function.

[0110] [Operation flow of the mobile projection device 1F according to the fourth embodiment] 12 and 13 are flowcharts showing an example of the flow of operations of the mobile projection device 1F of the fourth embodiment. In the following explanation, the control unit 101 will be described assuming that the control functions of the flight drive signal generation unit 109, the position and attitude control signal generation unit 110, the image recognition unit 113, the voice recognition unit 115, and the foreign language determination unit 122 are realized as software processing functions.

[0111] First, the control unit 101 sets the own device in a standby state at the home position (step S201). In this standby state, the control unit 101 sets the communication unit 121 in an operating state and monitors the communication unit 121 for reception of a call signal.

[0112] Then, the control unit 101 determines whether or not reception of a call signal through the communication unit 121 is detected (step S202), and if reception of a call signal is not detected, the process returns to step S201 and the standby state is maintained.

[0113] When the control unit 101 detects the reception of a call signal in step S202, the control unit 101 recognizes the identification information of the call post that transmitted the received call signal, and detects and recognizes the location of the call post (step S203). Then, the control unit 101 moves to one of the exhibition spaces 201 where the recognized call post is located, or to the entrance hall 207 (step S204). Prior to this movement, the control unit 101 controls the communication unit 121 to a sleep state or a stopped state so as not to respond to other call signals.

[0114] When the viewer moves to one of the exhibition spaces 201 where the call post that sent the call signal is located, or to the entrance hall 207, the control unit 101 recognizes the called viewer from the images captured by the cameras CM1 to CM5, and emits a guidance message audio from the speaker SP to guide the recognized viewer (including multiple viewers) to the location where the projection image will be projected, thereby guiding the viewer to the projection location (step S205).

[0115] Then, the control unit 101 detects or confirms the number of viewers from the image recognition results of the images captured by the cameras CM1 to CM5 (step S206).

[0116] Next, the control unit 101 determines an appropriate projection location and projection position according to the number of people, and an appropriate screen size of the projected image according to the number of people (step S207). Next, the control unit 101 determines the language used by the viewer from the voice recognition result of the voice information collected by the microphone MC, and selects the language used for the voice to be provided (step S208). As described above, when the language used by the viewer cannot be determined, the viewer is asked to select the language used, as described above. This selection of the language used by the viewer can also be performed by voice recognition.

[0117] Next, the control unit 101 controls the device to project the projection image at the projection position of the determined projection location with the determined screen size, and emits a guide message voice about the projected projection image from the speaker SP (step S209). The guide message voice used at this time is in the language selected in step S208. The volume of the voice provided from the speakers 9SL, 9SR of the projector 9 together with the display of the projection image is set to a volume according to the number of viewers (or the screen size of the projection image), as in the first embodiment.

[0118] Next, the control unit 101 monitors the voice recognition result of the voice picked up by the microphone MC, and determines whether or not a desired voice from the viewer viewing the projected projection image is detected (step S211 in FIG. 13). If it is determined in this step S211 that a desired voice from the viewer is detected, the control unit 101 sends a remote control signal to the projector 9 to change the projection image to a projection image according to the viewer's request (step S212).

[0119] Then, when it is determined in step S211 that no request voice from the viewer has been detected, or after the projection image to be projected has been changed in step S212, the control unit 101 determines whether or not the number of viewers has changed (step S213). When it is determined in this step S213 that the number of viewers has changed, the control unit 101 determines whether or not the projection location and / or screen size needs to be changed (step S214), and when it is determined that a change is necessary, the process returns to step S207, and the processes from step S207 onwards are repeated. Note that the determination criteria in step S214 can be set in various ways, similar to the determination criteria in step S114.

[0120] If it is determined in step S213 that the number of viewers has not changed, or if it is determined in step S214 that there is no need to change the projection location and / or screen size, the control unit 101 determines whether to end the projection image provision service based on whether all of the image information stored on the DVD has been projected or whether a voice requesting termination from a viewer has been recognized (step S215).

[0121] If it is determined in step S215 that the service of providing a projection image is not to be ended, the control unit 101 returns the process to step S209 and repeats the processes from step S209 onwards. If it is determined in step S215 that the service of providing a projection image is to be ended, the control unit 101 sends a remote control signal of end to the projector 9, and then flies back to the waiting place (step S216), and returns the communication unit 121, which was in a sleep state or stopped state, to an operating state, and restores the communication unit 121 to a state in which it can receive a call signal (step S217). Then, the control unit 101 returns the process to step S201 and goes into a waiting state.

[0122] According to the fourth embodiment described above, the mobile projection device 1F can respond to calls from places where the device itself cannot be seen, fly to the place, and provide projection images to viewers at a projection location and screen size corresponding to the number of viewers. In addition, if the viewers are foreigners and can use a language prepared in advance, it is possible to provide voice guidance messages and voice information accompanying the projection images in that language.

[0123] [Other embodiments or modifications] In the above example, the projection location to be determined is not considered to be easy to view at the location. However, for example, when the location is outdoors and exposed to direct sunlight, the projection image may be difficult to view even if it is projected at the location. The control unit 101 may be configured to take such a case into consideration. That is, the control unit 101 detects the brightness (illuminance) of the part onto which the image is to be projected, such as the wall surface of the location to be determined as the projection location of the projection image, and determines whether the brightness is equal to or lower than a predetermined threshold value that takes into consideration the ease of viewing of the projection image. If the brightness of the location is equal to or lower than the predetermined threshold value, the control unit 101 determines the location as the projection location and uses it as the location to project the projection image. On the other hand, if the brightness of the location is brighter than the predetermined threshold value, the control unit 101 does not determine the location as the projection location, and searches for another appropriate projection location.

[0124] In addition, when there are parts with different brightnesses in the same wall, if the area of ​​the part with brightness equal to or less than the predetermined threshold is larger than the screen size of the projection image of the projection image, that part can be determined as the projection location. For example, when a wall is in a position where it is exposed to direct sunlight, but there is a shadow area of ​​a predetermined area with brightness equal to or less than the threshold due to the shadow of an adjacent building, the projection image can be projected into that shadow area, and therefore the shadow area can be determined as the projection location.

[0125] In the above embodiment, the projector in the mobile projection device is fixed directly to the support base so as to be immobile. However, the projector may be mounted and fixed on a rotating base that rotates in the horizontal direction and is provided on the support base. In that case, instead of moving or rotating the mobile projection device itself in the horizontal direction to move the projection position of the projection image in the horizontal direction, the mobile projection device itself can be kept in a hovering state while the rotating base provided on the support base is rotated to rotate the projector, thereby moving the projection position of the projection image in the horizontal direction.

[0126] In addition, a tilt mechanism may be provided on the support stand that can change the direction of the projector's optical axis to point downward (in the direction of the dip angle) from a plane parallel to the bottom surface of the support stand, or upward (in the direction of the elevation angle) from a plane parallel to the bottom surface of the support stand. By fixing the projector to this tilt mechanism, the control unit 101 may control the tilt mechanism to move the projection position of the projection image in the vertical direction.

[0127] In the above embodiment, the projector 9 is provided with a DVD drive to reproduce image information and audio information stored on a DVD and provide a projection image and associated audio, but it is not limited to a DVD drive and may be provided with a BD (Blu-ray Disc), HDD (Hard Disk Drive), or SSD (Solid State Drive). It may also be provided with a flash memory such as a USB or SD card. Furthermore, the image information and audio information may be obtained from a cloud on the Internet.

[0128] In addition, in the above embodiment, the projector 9 is provided separately from the housing 6, but it goes without saying that the projector 9 may be incorporated into the housing 6. In that case, the remote control transmission unit and projector remote control I / F attached to the housing 6 and the remote control reception unit attached to the projector 9 are not necessary.

[0129] In the above embodiment, the projector has a function of reproducing image information and audio information from a storage medium, but the present invention is not limited to this. For example, the mobile projection device can be configured to receive projection image information and audio information transmitted from the outside via wireless communication, project the information by the projector, and reproduce the audio. In this case, the mobile projection device may select and receive the projection image information and audio information transmitted from the outside from among those transmitted in a broadcast format, or the mobile projection device may be configured to make a request to the providing server and obtain the projection image information and audio information corresponding to the request from the providing server.

[0130] In the above embodiment, the aerial flight mechanism 2 of the mobile projection device has been described as a helicopter-type mechanism having four rotary wing mechanisms, but the number of rotary wing mechanisms may be three or less or five or more. Furthermore, the mechanism is not limited to a helicopter-type mechanism, and may be an airplane-type mechanism, for example.

[0131] In the above embodiment, the number of cameras in the camera group 111 is five and the number of microphones is one, but the number is of course not limited. In addition, various positions for installing the cameras and microphones are possible. The camera may be a standard camera, a wide-angle camera, a fish-eye camera, or a 360-degree camera. In addition, a telephoto camera, an infrared camera, or the like may also be used. Of course, these cameras may be used in combination.

[0132] Furthermore, it goes without saying that there may be a plurality of gyro sensors, geomagnetic sensors, altitude sensors, and obstacle sensors.

[0133] In addition, in the case of a mobile projection device that is expected to be used outdoors, it is desirable to make it waterproof. If the waterproof specification is not sufficient, the mobile projection device needs to take defensive measures such as waiting in a place where it is not exposed to rain or snow during rain or snowfall and not flying. In addition, if the mobile projection device detects rain or snow during flight, or the possibility of rain or snowfall, the mobile projection device promptly lands in a place where it is not exposed to rain or snow and asks for instructions from the communicator. In this case, rain or snow is detected by a rainfall sensor or a snowfall sensor. In addition, if the mobile projection device is equipped with an umbrella, the umbrella may be used during rain or snowfall. In addition, the mobile projection device may be made capable of measuring wind force or wind speed, and may not fly outdoors when the wind is strong because there is a high possibility of an accident occurring.

[0134] Needless to say, various other modifications are possible in terms of the mechanism of the mobile projection device. [Explanation of symbols]

[0135] 1, 1AB, 1CDE, 1F...mobile projection device, 2...aerial flight mechanism, 9, 9A, 9B, 9C, 9D, 9E...projector, 101...control unit, 111...camera, 113...image recognition unit

Claims

1. an aerial flight mechanism for flying in the air; a projector unit for projecting an image; a speaker that outputs a sound related to the image; a camera for photographing a viewer viewing the projected image; a number-of-viewers detection unit that detects the number of viewers from the captured image of the camera; a control unit that controls a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection unit; A communication means for receiving call information; Equipped with Based on information for specifying a location included in the call information, the projector moves to a location near a viewer who is in a place where the call information is transmitted, and projects the image by the projector unit. A mobile projection device comprising:

2. A moving space information memory is provided for storing information on a moving space in which the device itself should fly and move, the moving space being divided into a plurality of mutually non-overlapping partial space regions; the moving space information memory stores information on a call device that transmits the call information and is installed in each of the partial space regions, and information on the partial space regions in which the call device is installed; The information for identifying the location included in the call information is information for identifying in which of the subspace regions the call device that sent the call information is installed.

2. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device.

3. an aerial flight mechanism for flying in the air; a projector unit for projecting an image; a speaker that outputs a sound related to the image; a camera for photographing a viewer viewing the projected image; a number-of-viewers detection unit that detects the number of viewers from the captured image of the camera; a control unit that controls a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection unit; means for detecting rain or snow, or the possibility of rain or snow; a means for moving the device to a place where it is not exposed to rain or snow when the device detects rain or snowfall or the possibility of rain or snowfall; A mobile projection device comprising:

4. an aerial flight mechanism for flying in the air; a projector unit for projecting an image; a speaker that outputs a sound related to the image; a camera for photographing a viewer viewing the projected image; a number-of-viewers detection unit that detects the number of viewers from the captured image of the camera; a control unit that controls a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection unit; means for detecting rain or snow, or the possibility of rain or snow; Umbrella and a means for controlling the use of the umbrella when the rainfall or snowfall is detected or the possibility of the rainfall or snowfall is detected; A mobile projection device comprising:

5. The control unit determines a size of an image to be projected in accordance with the number of viewers detected by the number-of-viewers detection unit, controls the projector unit to display an image of the determined size, and controls a volume of the sound to be emitted from the speaker in accordance with the size of the image to be projected.

5. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

6. When the presence of the viewer is detected from the image captured by the camera, the projector unit moves to the vicinity of the detected viewer and projects an image by the projector unit.

6. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

7. The number of viewers during image projection is monitored, and the volume of the sound emitted from the speaker is changed in response to a change in the number of viewers.

7. The mobile projection device according to claim 1, wherein the projection device is a projection type projection apparatus having a projection surface.

8. When the number of viewers is detected by the number-of-viewers detection unit to be a large number equal to or greater than a predetermined number, the control unit controls so as to project the image in a larger size than when the number of viewers is one or a small number less than the predetermined number, and / or to increase the volume of the sound emitted from the speaker.

8. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

9. a microphone for collecting the voice of the viewer; and a foreign language determination unit for determining a foreign language used by the viewer from the voice of the viewer collected by the microphone; the projector unit includes image information in a plurality of foreign languages ​​as image information of the image to be projected, a means for selecting the image information to be projected by the projector unit based on the foreign language determined by the foreign language determination unit; 9. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

10. a microphone for collecting the voice of the viewer; and a foreign language determination unit for determining a foreign language used by the viewer from the voice of the viewer collected by the microphone; the projector unit is provided with audio information in a plurality of foreign languages ​​as audio information accompanying the image to be projected, a means for selecting the audio information to be provided to the viewer in association with the image based on the foreign language determined by the foreign language determination unit; 10. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

11. Equipped with solar panels, it flies while charging with sunlight.

11. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

12. A microphone for picking up the voice of the viewer; a means for recognizing a request of the viewer based on a voice recognition result of the voice of the viewer picked up by the microphone; A control means for controlling the projection of the image according to the recognized desire; 12. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

13. The projector unit has a function of reproducing image information of the image to be projected from a storage medium.

9. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

14. The image information of the image projected by the projector unit is sent from the outside in a broadcast format.

9. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

15. The projector unit has a function of requesting and acquiring image information of the image projected by the projector unit from a server providing the image information.

9. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

16. The speaker has a function of reproducing audio information accompanying the image projected from a storage medium.

10. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

17. The audio information accompanying the image output by the speaker is sent from an external device in a broadcast format.

10. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

18. The apparatus has a function of requesting and acquiring audio information accompanying the image emitted by the speaker from a server providing the audio information.

10. The mobile projection device according to claim 1, wherein the projection device is a projection type projection device having a projection surface.

19. A computer provided in a mobile projection device including an aerial flight mechanism for flying in the air, a projector for projecting an image, a speaker for emitting sound related to the image, a camera for photographing a viewer viewing the projected image, and a communication means for receiving call information, a number-of-viewers detection means for detecting the number of viewers from the image captured by the camera; a means for controlling a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection means; a means for controlling the aerial flight mechanism unit to move to the vicinity of a viewer who is in a place where the call information is transmitted, based on information for specifying a location included in the call information, and for controlling the projector unit to project the image; A program for a mobile projection device to function as a

20. A computer provided in a mobile projection device including an aerial flight mechanism for flying in the air, a projector for projecting an image, a speaker for emitting sound related to the image, a camera for photographing a viewer viewing the projected image, and a means for detecting rainfall or snowfall, a number-of-viewers detection means for detecting the number of viewers from the image captured by the camera; a control means for controlling a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection means; a means for controlling the flight mechanism unit so as to move the device to a location that is not exposed to rain or snow when rainfall or snowfall is detected; A program for a mobile projection device to function as a

21. A computer provided in a mobile projection device including an aerial flight mechanism for flying in the air, a projector for projecting an image, a speaker for emitting sound related to the image, a camera for photographing a viewer viewing the projected image, a means for detecting rainfall or snowfall, and an umbrella, a number-of-viewers detection means for detecting the number of viewers from the image captured by the camera; a control means for controlling a volume of the sound emitted from the speaker in accordance with the number of viewers detected by the number-of-viewers detection means; a control means for controlling the use of the umbrella when the rainfall or snowfall is detected; A program for a mobile projection device to function as a

Images