Image projection device
The image projection device addresses visibility issues by incorporating a movement and control system to adapt projection to viewer presence and environmental changes, ensuring clear image display despite obstacles.
Patent Information
- Application Number
- JP2025101338
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-06-17
- Publication Date
- 2025-08-22
AI Technical Summary
Conventional image projection devices struggle with image visibility issues when there are obstacles between the projection surface and the viewer, such as when multiple people are present or the robot is positioned between the viewer and the projection surface, leading to partial or complete obstruction of the image.
An image projection device equipped with a movement unit, control unit, photographing unit, viewer detection unit, and situation detection unit, which collectively adjust the projection to ensure clear image display by moving the projection unit, correcting distortions, and adapting to viewer presence and environmental changes.
The device ensures reliable and environment-independent image projection by dynamically adjusting the projection based on viewer detection and environmental conditions, maintaining image clarity and visibility.
Smart Images

Figure 2025123403000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an image projection device that projects an image. [Background technology]
[0002] In recent years, there has been an increasing diversity of opportunities to view images, such as video advertisements at stations and stores, watching videos on smartphones, etc. Specifically, a related technology has been available in the past, for example, relating to a video display system that is equipped with a projection unit on an autonomously moving robot, and that projects an image onto a projection surface while detecting the state of a projection surface present around the robot, thereby enabling the display of an image that is easily visible to unspecified people (see, for example, Patent Document 1 below). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-125816 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the conventional technology described in Patent Document 1 mentioned above allows a viewer who is close to the robot to see the image, but when there are multiple people between the robot and the viewer, or when the robot is positioned between the viewer and the projection surface, there is a problem in that part of the image is missing or the viewer cannot see it at all.
[0005] In order to solve the problems of the conventional technology described above, an object of the present invention is to provide an image projection device that can easily and reliably project an image at a desired location regardless of the environment. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems and achieve the object, the image projection device of the present invention is characterized by comprising an image projection unit that projects an image, a movement unit that moves the image projection unit, and a control unit that controls the movement unit in conjunction with the projection of the image by the image projection unit.
[0007] In addition, the image projection device of the present invention is characterized in that, in the above invention, it is provided with a photographing unit that photographs the image projected by the image projection unit, and the control unit controls the moving unit based on the image projected by the image projection unit and the image photographed by the photographing unit, and moves the image projection unit.
[0008] In addition, the image projection device of this invention is characterized in that, in the above invention, the control unit detects whether or not the image projected by the image projection unit is distorted based on the image captured by the imaging unit, and corrects the distortion of the image projected by the image projection unit based on the detection result.
[0009] In addition, the image projection device of this invention is characterized in that, in the above invention, it is provided with a viewer detection unit that detects a viewer who will view the image projected by the image projection unit, and the control unit controls the movement unit based on the detection result of the viewer detection unit to move the image projection unit.
[0010] In the image projection device according to the present invention, the surroundings of the viewer are changed. The image projection device is characterized in that it includes a situation detection unit that detects a situation, and the control unit switches the image projected by the image projection unit based on the detection result of the situation detection unit.
[0011] In addition, the image projection device of this invention is characterized in that, in the above invention, the control unit detects the movement of the viewer based on the detection result of the viewer detection unit, controls the movement unit to project an image forward in the direction of movement of the viewer, and moves the image projection unit.
[0012] In addition, the image projection device of the present invention is characterized in that, in the above invention, it is provided with a situation detection unit that detects the situation ahead in the direction of movement of a viewer who visualizes the image projected by the image projection unit, and the control unit switches the image projected by the image projection unit based on the detection result of the situation detection unit. [Effects of the Invention]
[0013] The image projection device according to the present invention has the advantage that it is possible to easily and reliably project an image at a desired location, regardless of the environment. [Brief explanation of the drawings]
[0014] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of the appearance of an image projection device. [Figure 2] FIG. 1 is an explanatory diagram showing a hardware configuration of an image projection device. [Figure 3] FIG. 2 is a block diagram illustrating an example of a functional configuration of the image projection device. [Figure 4] FIG. 1 is an explanatory diagram (part 1) showing an example of a usage mode of an image projection device. [Figure 5] FIG. 2 is an explanatory diagram (part 2) showing an example of a usage mode of the image projection device. [Figure 6] 10 is a flowchart illustrating an example of a processing procedure of the image projection device. [Figure 7] FIG. 10 is an explanatory diagram illustrating an example of an image projection device according to another embodiment of the present invention and an environment in which the image projection device moves. DETAILED DESCRIPTION OF THE INVENTION
[0015] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of an image projection device according to the present invention will be described in detail below with reference to the accompanying drawings.
[0016] <Embodiment> (Example of the appearance of an image projection device) First, an example of the appearance of an image projection device according to an embodiment of the present invention will be described. Fig. 1 is an explanatory diagram showing an example of the appearance of an image projection device. As shown in Fig. 1, an image projection device 100 includes a projector 101, a drone 102, a camera 103, and a motion sensor 104.
[0017] The projector 101 includes a projector light source, an optical system, a projection lens, and the like (all of which are not shown). The projector 101 guides light emitted from the projector light source along a predetermined path using the optical system and projects the light outside the projector 101 via the projection lens 101a, thereby projecting an image at the location where the light is irradiated. The optical system includes an integrator lens that improves the uniformity of the illuminance of the light emitted from the projector light source, a polarization conversion element that converts (polarizes) light emitted from a non-polarized light source into a predetermined polarization direction, a dichroic mirror that separates the light from the projector light into the three primary colors of R, G, and B, a liquid crystal panel that displays an image corresponding to the light of each color of R, G, and B, and a dichroic prism that combines the images of each color displayed by each liquid crystal panel (all of which are not shown).
[0018] As the projector 101, for example, a laser projector that uses a laser as a projector light source can be used. By using this, it is possible to miniaturize the projector 101. Specifically, a laser projector can suppress heat generation to a lower level than a mercury lamp projector that uses a mercury lamp as the projector light source, and therefore it is possible to achieve miniaturization and weight reduction by eliminating mechanisms such as a cooling fan.
[0019] Furthermore, by using a laser projector, it is possible to quickly start up and start projecting an image, and by using a laser projector, it is possible to achieve higher brightness of the projected image while reducing power consumption compared to a mercury lamp projector.
[0020] Mercury lamp projectors are recommended to be used with the projection (optical axis) direction horizontal, which limits the degree of freedom in projection direction, whereas laser projectors can be used with the optical axis tilted from the horizontal.This allows laser projectors to have a high degree of freedom in projection direction, and they can project images not only onto walls but also onto the ground and floor.
[0021] The drone 102 moves the projector 101. By moving the projector 101 using the drone 102, which is also called an unmanned aerial vehicle, the location where an image is projected by the projector 101 can be moved. Specifically, the drone 102 can be, for example, a quadcopter equipped with four propellers 105. The drone 102 is not limited to a quadcopter, and various types of multicopters can be used, such as a hexacopter equipped with six propellers or an octocopter equipped with eight propellers.
[0022] The projector 101 is fixed to the drone 102 and moves as the drone 102 moves (flies). The projector 101 may be connected to the drone 102 in a state where its attitude can be adjusted. Specifically, for example, the projector 101 can be connected to the bottom of the drone 102 via a universal joint such as a ball joint. By connecting the projector 101 to the drone 102 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the projector 101 can be ensured.
[0023] In this case, the image projection device 100 may be provided with a drive mechanism that changes the attitude of the projector 101 relative to the drone 102, in order to adjust the attitude of the projector 101 relative to the drone 102 without human intervention. The drive mechanism can be configured, for example, with a motor, a gear train, or the like. By making the attitude of the projector 101 relative to the drone 102 adjustable, it is possible to project an image at an optimal angle depending on the location where the image is to be projected.
[0024] The camera 103 captures the image projected by the projector 101. Specifically, the camera 103 can be realized by, for example, a general-purpose digital camera. The camera 103 is fixed to the drone 102 with the lens 103a facing in the same direction as the image projection direction by the projector 101, for example.
[0025] The camera 103 may be connected to the drone 102 in a state where the direction in which the lens is pointed relative to the projection direction of the image by the projector 101 can be adjusted. In FIG. 1, the camera 103 can be rotated around an axis that connects the camera 103 to the drone 102. The camera 103 may be connected to the bottom of the drone 102 via a universal joint such as a ball joint. By connecting the camera 103 to the drone 102 via a universal joint such as a ball joint, the attitude of the camera 103 can be adjusted with a high degree of freedom. can be secured.
[0026] In this case, the image projection device 100 may be provided with a drive mechanism that changes the attitude of the camera 103 relative to the drone 102 in order to adjust the direction in which the lens 103a is pointed without human intervention. The drive mechanism may be configured, for example, with a motor, a gear train, or the like. By making it possible to adjust the direction in which the lens 103a is pointed relative to the projection direction of the image by the projector 101, it is possible to use a single camera 103 to capture an image projected by the projector 101 and an image around the image projection device 100.
[0027] In the image projection device 100, the drive mechanism that adjusts the attitude of the projector 101 relative to the drone 102 and the drive mechanism that adjusts the attitude of the camera 103 relative to the drone 102 may operate independently. This makes it possible to project an image using the projector 101 while capturing the projected image using the camera 103, or to adjust the attitude of the camera 103 to capture an image in a direction different from the projection direction of the image.
[0028] The camera 103 is not limited to a general-purpose digital camera, and may be realized by, for example, a night-vision camera that captures images in dark places by amplifying its sensitivity to light, or an infrared camera that is sensitive to infrared light. By incorporating such a camera 103, it is possible to clearly capture images projected by the projector 101, even at night, without using a light source for auxiliary imaging. This makes it possible to suppress increases in the weight and power consumption of the image projection device 100.
[0029] The human presence sensor 104 detects viewers present within a predetermined range from the image projection device 100. Viewers are the targets for viewing the image projected by the image projection device 100. Specifically, the human presence sensor 104 can be realized, for example, by an infrared sensor. The infrared sensor uses a temperature sensor to detect a temperature increase (temperature change) caused by a light-receiving element absorbing infrared rays emitted by a detected object, such as a viewer of the image projected by the image projection device 100, and outputs a predetermined electrical signal. Using the infrared sensor makes it possible to detect the presence or absence of a viewer and the movement of the viewer.
[0030] The detection range of a visible person by the human presence sensor 104 realized by an infrared sensor can be adjusted, for example, by adjusting the sensitivity of the infrared sensor, the number and arrangement of the sensor elements (pixels), the amplification factor of the current sensed by the sensor elements (pixels), etc. The human presence sensor 104 is not limited to being realized by an infrared sensor, and may be one that detects a visible person using, for example, ultrasonic waves or visible light, or one that detects a visible person using a method that combines infrared rays and ultrasonic waves.
[0031] (Hardware configuration of image projection device 100) Next, the hardware configuration of the image projection device 100 will be described. Fig. 2 is an explanatory diagram showing the hardware configuration of the image projection device 100. As shown in Fig. 2, the hardware of the image projection device 100 is made up of a battery 201, a control circuit 202, a communication I / F 203, a GPS receiver 204, a motor 205, a projector 101, a camera 103, a motion sensor 104, a microphone 206, a speaker 207, etc. The units 101, 103, 104, 201 to 207 included in the image projection device 100 are connected by a bus 200.
[0032] The battery 201 supplies power required for the operation of each unit included in the image projection device 100. The battery 201 can be realized by a secondary battery (rechargeable battery, storage battery) such as a lithium battery. It may be detachable from the ring 102.
[0033] The image projection device 100 may also include a charging contact for charging the battery 201. The charging contact may have, for example, an exposed terminal or a connector shape. Alternatively, the image projection device 100 may include a power receiving coil for wireless power transfer (contactless power transmission) instead of or in addition to the charging contact for charging the battery 201.
[0034] Wireless power supply is a technology for receiving power from the battery 201 without using a charging contact, and is also called contactless power supply or wireless power supply. The power receiving coil is provided inside the exterior surface of the drone 102. This makes it possible to prevent deterioration or failure of the image projection device 100 due to water droplets from rain or dew. The battery 201 may be realized by a primary battery that only discharges DC power.
[0035] The control circuit 202 is configured with a CPU, memory, etc., and drives and controls each unit of the image projection device 100. The CPU executes programs stored in the memory to control the entire image projection device 100. The memory stores the programs executed by the CPU. The memory also stores various information including, for example, image information related to the image to be projected.
[0036] Specifically, the memory can be realized by, for example, an IC memory or an SSD (Solid State Drive). The memory may also be a memory card that is detachable from the image projection device 100 via a card slot provided in the image projection device 100. The memory card's function can be realized by, for example, an IC card such as an SD (Secure Digital) memory card. The memory's function may also be realized by an external hard disk or USB memory.
[0037] Specifically, the control circuit 202 includes, for example, a flight controller and an ESC (Electronic Speed Controller). The control circuit 202 may further include a BEC (Battery Elimination Circuit) and a UBEC (Universal BEC). In addition, when the battery 201 is realized by a secondary battery, the control circuit 202 may include a charging circuit that charges (stores) the battery 201.
[0038] The flight controller performs calculations related to the rotation control of the motor 205 and outputs a control signal. The ESC controls the rotation of the motor 205 based on the control signal output from the flight controller. While the image projection device 100 is flying, the flight controller detects the tilt of the image projection device 100 and repeatedly performs calculations to recursively output a control signal to the motor 205.
[0039] The flight controller outputs control signals to the ESC to control the direction and speed of rotation of the propellers (propeller motors 205). Specifically, for example, the rotation of the image projection device 100 is prevented by outputting control signals that control adjacent propellers to rotate in opposite directions. Also, for example, the image projection device 100 is caused to move forward by controlling the propeller at the front in the direction of travel to rotate slower than the propeller at the rear in the direction of travel. Also, for example, the image projection device 100 is caused to turn right by controlling the propeller at the right in the direction of travel to rotate slower than the propeller at the left in the direction of travel.
[0040] Specifically, the control circuit 202 includes, for example, a GPU (Graphics Processing Unit) that is specialized for image processing related to images projected by the projector 101. By including a GPU, it is possible to project fast-moving videos and the like with high image quality.
[0041] The communication I / F 203 is an interface that connects the image projection device 100 and the network N via a communication line, and controls the interface between the network N and the inside of the image projection device 100, and controls the input of data from and the output of data to external devices connected via the network N. The network N is realized by, for example, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or the like.
[0042] The communication I / F 203 is, for example, a wireless interface based on Wi-Fi (registered trademark). The communication I / F 203 may also be connected to a mobile phone line (for example, LTE (Long Term It may also be an interface for wireless communication such as a Personal Handy-phone System (PHS) or a Personal Handy-phone System (PHS).
[0043] The control circuit 202 can acquire various types of information, including image information related to an image to be projected, from the external device by communicating with the external device via the communication I / F 203. Furthermore, every time the control circuit 202 acquires various types of information from the external device, it may store the acquired information in memory or update the contents of the memory based on the acquired information.
[0044] The GPS receiver 204 identifies the current position of the image projection device 100. Specifically, the GPS receiver 204 includes, for example, a GPS antenna, an RF (Radio Frequency) unit, and a baseband unit. The GPS antenna receives radio waves broadcast by GPS satellites. The RF unit demodulates the pre-modulation signal received by the GPS antenna into a baseband signal. The baseband unit calculates the current position of the image projection device 100 based on the baseband signal demodulated by the RF unit. The GPS receiver 204 may further include a filter that removes unnecessary components and an amplifier such as an LNA (Low Noise Amplifier) or a PA (Power Amplifier).
[0045] The current position of the image projection device 100 can be determined by positioning based on radio waves transmitted from multiple GPS satellites. The baseband unit calculates the distances to each of the four GPS satellites and calculates the position where the distances intersect. Instead of GPS, which determines the geometric position of the GPS satellite and the image projection device 100 based on radio waves received from the GPS satellite, the current position of the image projection device 100 may be determined using a satellite positioning system such as Michibiki, GLONASS, or Galileo.
[0046] Motor 205 is controlled by control circuit 202, and rotates propeller 105 by rotating. Specifically, motor 205 may be, for example, a brushless motor in which the rotor is a permanent magnet and the stator is configured by a coil. The same number of motors 205 as the number of propellers 105 may be provided. This allows each propeller 105 to rotate independently, making it possible to move image projection device 100 forward, backward, and turn left and right.
[0047] When a driving mechanism for adjusting the attitude of the projector 101 or the camera 103 is provided, the control circuit 202 also controls the operation of the motor 205 provided in each of these driving mechanisms. The postures of each can be adjusted independently (individually).
[0048] As described above, the projector 101 guides light emitted from the projector light source along a predetermined path using an optical system and projects the light outside the projector 101 via the projection lens 101a, thereby projecting an image at the location where the light is irradiated. The projector 101 may adjust the image quality of the projected image by adjusting the intensity of the light emitted from the projector light source according to the distance from the location where the image is to be projected. The distance between the projector 101 and the location where the image is to be projected can be determined using, for example, a distance sensor. The distance sensor can be any of various known sensors, such as a laser distance sensor, an ultrasonic sensor, or an infrared sensor.
[0049] The camera 103 is equipped with an imaging element, and generates image information (photographed data) by converting light received by the imaging element through a photographing lens into an electrical signal. The generated image information is output to the control circuit 202. The camera 103 may be one that captures still images or one that captures moving images. Moving images include those that continuously play back still images captured at predetermined time intervals. The image information may be compressed using a predetermined standard for video and audio data compression (for example, MPEG (Moving Picture Experts Group)).
[0050] The human presence sensor 104 outputs an electrical signal corresponding to a temperature change caused by the light receiving element absorbing infrared rays to the control circuit 202. Specifically, the human presence sensor 104 converts a current signal corresponding to the temperature change into a voltage signal and amplifies it, and when the amplified voltage signal exceeds a predetermined threshold, outputs a predetermined electrical signal to the control circuit 202. When the control circuit 202 receives an input of the predetermined electrical signal output from the human presence sensor 104, it detects a person viewing the image.
[0051] The microphone 206 collects sound around the image projection device 100. The microphone 206 converts sound input as analog data into an electrical signal. Specifically, the microphone 206 performs analog-to-digital conversion on the analog sound signal input as analog data, and generates digital sound data.
[0052] Speaker 207 generates sound by vibrating a diaphragm with an electric signal, which is an audio signal. Speaker 207 may also be an output terminal that outputs an audio signal, and an external speaker may be connected to the output terminal to generate sound.
[0053] Although not shown, the image projection device 100 may also include an LED lamp that indicates the state of the image projection device 100, and an input / output device such as a key or button that inputs instructions to the image projection device 100. The input / output device may be realized by a connection terminal to which another information processing device can be connected.
[0054] The image projection device 100 may also include a memory card I / F, which is an interface connected to the image projection device 100 via a card slot. The memory card I / F controls the internal interface with the memory card and controls the input of data from and the output of data to the memory card. This allows the image to be projected by the image projection device 100 to be stored in the memory card, and the image to be projected by the image projection device 100 to be switched simply by replacing the memory card.
[0055] (An example of a functional configuration of the image projection device 100) Next, an example of the functional configuration of the image projection device 100 will be described. FIG. 3 is a block diagram showing an example of the functional configuration of the image projection device 100. As shown in FIG. 3, in the present invention, The functions of the image projection device 100 in this embodiment are realized by a control unit 301, a memory unit 302, an image projection unit 303, a photographing unit 304, a viewer detection unit 305, a situation detection unit 306, and a movement unit 307.
[0056] The control unit 301 controls the entire image projection device 100. Specifically, the control unit 301 can realize its functions by, for example, the control circuit 202 shown in Fig. 2. More specifically, the control unit 301 can realize its functions by, for example, executing a program stored in a memory or the like by a CPU in the control circuit 202 shown in Fig. 2.
[0057] The storage unit 302 stores various programs related to the control by the control unit 301 and various information including thresholds used for executing the programs. The storage unit 302 may also store image information related to the image projected by the image projection unit 303, information related to the movement (flight) range of the image projection device 100, information related to battery charging spots, etc. Specifically, the function of the storage unit 302 can be realized by, for example, a memory in the control circuit 202 shown in FIG. 2.
[0058] The storage unit 302 may store information input in advance by an administrator of the image projection device 100, or may store information acquired through communication via the communication I / F 203. Communication via the communication I / F 203 may be performed periodically, such as at a predetermined time or at predetermined intervals, or may be performed at any timing depending on the status of the communication line, etc.
[0059] Image projection unit 303 is controlled by control unit 301 and projects a predetermined image. Image projection unit 303 projects an image based on image information stored in a memory, for example. In this case, the function of image projection unit 303 can be specifically realized by, for example, projector 101 shown in FIG. 1 or FIG. 2 or a memory in control circuit 202 shown in FIG. 2.
[0060] Furthermore, the image projection unit 303 may project an image based on image information acquired from an external device via the communication I / F 203. In this case, the image projection unit 303 can specifically realize its functions by, for example, the projector 101 shown in FIG. 1 or FIG. 2 or the communication I / F 203 shown in FIG. 2.
[0061] A fresh image can be displayed by displaying an image based on image information acquired from an external device via the communication I / F 203. That is, by projecting an image based on image information acquired from an external device such as a predetermined server via the communication I / F 203 immediately before the image is projected, a fresh image based on the latest image information stored in the server can be projected.
[0062] Specifically, the image projection unit 303 projects, for example, an advertisement image to a viewer. The advertisement image may be a still image or a moving image. The image projected by the image projection unit 303 is not limited to an advertisement, and may be realized by an image file such as a still image of a map or a moving image of an entertainment work such as a drama or a movie. The image information stored in the memory may be an HTML file, or may be composed of an image file and an HTML file.
[0063] Audio information may be associated with the image information relating to the advertisement image. In this way, if the image projection device 100 is equipped with a speaker 207, audio can be output to viewers in conjunction with the projection of the image. By outputting audio, it is possible to more easily draw the viewers' attention to the image, such as an advertisement, projected by the image projection device 100, and this can improve the viewers' enjoyment of the image. This allows the observer to reliably see the image.
[0064] Furthermore, the image projection unit 303 may project an image that calls the viewer's attention, for example. Specifically, the image projection unit 303 may project an image that notifies the viewer that a vehicle is approaching, an image that calls the viewer's attention to the road conditions ahead in the viewer's direction of travel, or an image that notifies the viewer of the possibility of an earthquake, lightning, sudden heavy rain, etc.
[0065] The image capturing unit 304 is controlled by the control unit 301 and captures the image projected by the projector 101. The image capturing unit 304 may also capture the surroundings of the image projection device 100. Specifically, the function of the image capturing unit 304 can be realized by, for example, the camera 103 shown in FIGS. 1 and 2.
[0066] The viewer detection unit 305 is controlled by the control unit 301 and detects a viewer who views an image projected by the projector 101. The viewer detection unit 305 may also detect the movement of the viewer. Specifically, for example, based on the current position of the image projection device 100 identified by the GPS receiver 204 and the position of the viewer detected by the viewer detection unit 305, it is possible to detect whether the viewer is moving and the direction of movement of the viewer.
[0067] The viewer detection unit 305 detects a viewer who is within a predetermined range from the image projection device 100, for example, based on the detection result of the human presence sensor 104. In this case, the viewer detection unit 305 can specifically realize its function by, for example, the human presence sensor 104 shown in FIG. 1 or FIG. 2.
[0068] The viewer detection unit 305 may detect a viewer based on, for example, an image captured by the camera 103. Specifically, the viewer can be detected by analyzing the image captured by the camera 103 and determining whether or not a person is captured in the image. In this case, the viewer detection unit 305 can specifically realize its function by, for example, the camera 103 shown in FIG. 1 or FIG. 2.
[0069] When the viewer detection unit 305 is implemented using the camera 103, the viewer may be detected by moving the image projection device 100 itself and changing the shooting range of the camera 103. In this case, the viewer detection unit 305 can further realize its functions using the flight controller, ESC, BEC, UBEC, motor 205 in the control circuit 202 shown in FIG. 2, the propeller 105 shown in FIG. 1, etc.
[0070] When the camera 103 that realizes the viewer detection unit 305 is connected to the drone 102 in a state where the direction in which the lens is pointed relative to the projection direction of the image by the projector 101 can be adjusted, the viewer may be detected by adjusting the attitude of the camera 103 relative to the drone 102. In this case, the viewer detection unit 305 can further realize its function by a mechanism that adjusts the direction in which the lens of the camera 103 is pointed relative to the projection direction of the image by the projector 101.
[0071] When the viewer detection unit 305 is realized using the camera 103, the viewer detection unit 305 may further detect (determine) the attributes of the viewer. Specifically, for example, the gender, age, etc. of the detected viewer may be detected. Alternatively, the viewer's preferences regarding clothing and belongings may be detected from the clothing of the detected viewer. Detection of the attributes of a person (viewer) in an image based on the image can be easily realized using various known technologies.
[0072] The situation detection unit 306 detects the situation around the viewer. For example, the situation detection unit 306 detects the situation around the viewer based on the sound collected by the microphone 206. In this case, the function of the situation detection unit 306 can be realized specifically by, for example, the microphone 206 shown in FIG.
[0073] Furthermore, the situation detection unit 306 may detect the situation around the viewer, for example, based on the detection result of the human presence sensor 104. In this case, the situation detection unit 306 can specifically realize its function by, for example, the human presence sensor 104 shown in Fig. 1 or 2. When the situation detection unit 306 is realized using the human presence sensor 104, it can detect, for example, people other than the viewer, animals, automobiles, etc.
[0074] Furthermore, the situation detection unit 306 may detect the situation around the viewer, for example, based on an image captured by the camera 103. In this case, the situation detection unit 306 can specifically realize its function by, for example, the camera 103 shown in FIG. 1 or FIG. 2.
[0075] When the situation detection unit 306 is realized using the camera 103, a wide range for detecting the situation around the viewer may be secured by moving the image projection device 100 itself and changing the shooting range of the camera 103. In this case, the situation detection unit 306 can further realize its functions using the flight controller, ESC, BEC, UBEC, motor 205 in the control circuit 202 shown in FIG. 2, the propeller 105 shown in FIG. 1, etc.
[0076] When the camera 103 that realizes the situation detection unit 306 is connected to the drone 102 in a state where the direction in which the lens is pointed relative to the projection direction of the image by the projector 101 can be adjusted, the situation around the viewer may be detected by adjusting the attitude of the camera 103 relative to the drone 102. In this case, the situation detection unit 306 can further realize its function by a mechanism that adjusts the direction in which the lens of the camera 103 is pointed relative to the projection direction of the image by the projector 101.
[0077] When the situation detection unit 306 is realized using the camera 103, it is possible to detect, for example, people other than the viewer, animals, automobiles, etc., as well as unevenness in the road surface that may hinder walking and obstacles that do not emit infrared rays. For example, by realizing the situation detection unit 306 using a general-purpose digital camera, it is possible to reliably detect the situation around the viewer, especially when the surroundings are bright.
[0078] The situation detection unit 306 may detect the situation around the viewer based on information acquired from a network N such as the Internet via the communication I / F 203. In this case, the situation detection unit 306 can specifically realize its functions by, for example, the control circuit 202 and the communication I / F 203 shown in FIG.
[0079] The situation detection unit 306 realized using the communication I / F 203 can detect, for example, the occurrence of an earthquake in an area including the viewer's current location, the possibility of lightning strikes, the possibility of sudden heavy rain known as a torrential downpour, etc. as the situation around the viewer. The current location of the viewer can be considered equivalent to the current location of the image projection device 100, which is identified by the GPS receiver 204. Therefore, the situation detection unit 306 realized using the communication I / F 203 can further realize its functions using the GPS receiver 204.
[0080] The situation detection unit 306 may detect the situation ahead in the direction of movement of the viewer. In this case, when the situation detection unit 306 detects the movement of the viewer based on the detection result of the viewer detection unit 305, for example, it detects the situation ahead in the direction of movement of the viewer and within a predetermined range from the viewer. This makes it possible to detect the situation more quickly than when detecting the situation around the entire area surrounding the viewer (for example, the entire area within a circle of a predetermined radius centered on the viewer).
[0081] The moving unit 307 is controlled by the control unit 301 and is responsible for moving the image projection device 100. By moving the image projection device 100 with the moving unit 307, the projector 101 can be moved. Specifically, the function of the moving unit 307 can be realized by, for example, the drone 102 shown in FIG. 1 or the control circuit 202 shown in FIG. 2. More specifically, the function of the moving unit 307 can be realized by, for example, rotating the motor 205 shown in FIG. 2 and rotating the propeller 105 shown in FIG. 1 using the flight controller, ESC, BEC, UBEC, etc. in the control circuit 202 shown in FIG. 2.
[0082] The control unit 301 controls the moving unit 307 based on, for example, the image projected by the image projection unit 303 and the image captured by the capturing unit 304, to move the image projection unit 303. Specifically, the control unit 301 compares, for example, the image projected by the image projection unit 303 with the image captured by the capturing unit 304, and if the shape of the outer frame of the image or the objects, colors, contrast, etc. in the captured image differ by a predetermined threshold or more, determines that a clear image is not being displayed because the image is projected in an inappropriate location or because the distance between the location where the image is to be projected and the image projection device 100 is inappropriate, and controls the moving unit 307 to move the image projection unit 303 to a position where the image quality of the image captured by the capturing unit 304 compared to the image projected by the image projection unit 303 falls within an acceptable range.
[0083] In this case, the control unit 301 controls the movement unit 307 to move the image projection unit 303 while keeping the image projection position constant, for example. This allows the viewer to view the original image without having to move their line of sight or their standing position, even if there is an obstacle blocking the image between the location where the image is projected and the image projection unit 303.
[0084] Alternatively, in this case, the control unit 301 may control the movement unit 307 to change the position where the image is projected to a position where the image quality of the projected image is within an acceptable range. In this way, if the location where the image was previously projected has unevenness or the like and an image with good reproducibility is not being projected, the position where the image is projected can be changed to allow the viewer to see the original image.
[0085] Furthermore, the control unit 301 may detect whether or not there is distortion in the image projected by the image projection unit 303 based on the image captured by the image capture unit 304, and may perform distortion correction on the image projected by the image projection unit 303 based on the detection result. In this case, specifically, if the image projection unit 303 projects an image whose outer edge is rectangular but the outer edge of the image captured by the image capture unit 304 is not rectangular, the control unit 301 determines that there is an obstacle blocking the image between the location where the image is projected and the projector 101, or that the location where the image is projected is uneven and an image with good reproducibility is not being projected, and moves the image projection unit 303 to a position where the outer edge of the projected image is rectangular.
[0086] When correcting image distortion based on shape, control unit 301 is not limited to a unit that completely matches the outer edge shape of the projected image with the outer edge shape of the image captured by image capturing unit 304. When correcting image distortion based on shape, control unit 301 may, for example, move image projection unit 303 to a position where the deviation of the outer edge shape of the image captured by image capturing unit 304 from the outer edge shape of the projected image falls within a predetermined range. The deviation of the outer edge shape of the images can be determined, for example, based on the aspect ratio of each image.
[0087] The image distortion correction by the control unit 301 can be realized by using various known image distortion correction techniques. Similarity), MSE (Mean Square Error Image distortion can be corrected using techniques such as image quality assessment (e.g., color and tone reproduction, sharpness, graininess, etc.), image distortion correction (Distortion Difference), and PSNR (Peak Signal-to-Noise Ratio).
[0088] When correcting image distortion, control unit 301 may also control movement unit 307 to move image projection unit 303 while keeping the image projection position constant, or control movement unit 307 to change the image projection position to a position where the image quality of the projected image falls within an acceptable range. This allows the viewer to see the original image.
[0089] Furthermore, the control unit 301 may control the movement unit 307 based on the detection result of the viewer detection unit 305 to move the image projection unit 303. Specifically, for example, when the viewer detection unit 305 detects a viewer, the control unit 301 controls the movement unit 307 to move the image projection unit 303 so that it approaches the viewer and projects an image around the viewer. This reduces the power consumption of the image projection device 100 and increases the reliability that the projected image will be seen by the viewer, compared to when an image is projected regardless of whether or not a viewer is present. This allows an advertiser to expect a high advertising effect, for example, when projecting an advertisement image.
[0090] Furthermore, the control unit 301 may control the movement unit 307 to move the image projection unit 303 so as to project an image ahead in the direction of movement of the viewer, based on the detection result of the viewer detection unit 305. Specifically, for example, when the viewer detection unit 305 detects the movement of a viewer, the control unit 301 controls the movement unit 307 to move the image projection unit 303 so as to approach the viewer and project an image ahead in the direction of movement of the viewer. This reduces the power consumption of the image projection device 100 and further increases the reliability that the projected image will be seen by the viewer, compared to when an image is projected regardless of whether or not a viewer is present. This allows an advertiser to expect a high advertising effect, for example, when projecting an advertisement image.
[0091] Furthermore, the control unit 301 switches the image projected by the projector 101 based on the detection result of the situation detection unit 306. For example, if the situation detection unit 306 detects that a vehicle has entered within a predetermined range from the viewer while the projector 101 is projecting an advertisement image, the control unit 301 replaces the image that was projected before the detection with an image that warns the viewer of an approaching vehicle and of an accident due to an approaching vehicle.
[0092] For example, when the situation detection unit 306 detects the possibility of an earthquake, lightning, or sudden heavy rain while the projector 101 is projecting an advertisement image, the control unit 301 may replace the image that was projected before the detection with an image that provides information about the possibility of an earthquake, lightning, or sudden heavy rain, as well as evacuation routes and methods. This allows a viewer who is out and about in an unfamiliar place to take appropriate action against an event that may occur in the near future.
[0093] (Example of usage of image projection device 100) Next, a description will be given of an example of a usage mode of the image projection device 100. Figures 4 and 5 are explanatory diagrams showing an example of a usage mode of the image projection device 100.
[0094] As shown in Fig. 4, the image projection device 100 can be deployed and used in, for example, a parking lot 400 of a large shopping mall. One or more image projection devices 100 can be deployed depending on the size of the parking lot 400, the number of cars that can be parked, the shape of the parking lot 400, and the like. Specifically, for example, more image projection devices 100 are deployed in a larger parking lot 400 than in a smaller parking lot 400. Also, for example, more image projection devices 100 are deployed in a parking lot 400 that is farther from a store in a shopping mall than in a parking lot 400 that is closer.
[0095] Also, for example, in a parking lot 400 with a large number of parking spaces, more image projection devices 100 are deployed than in a parking lot 400 with a small number of parking spaces. The same number of image projection devices 100 as the number of parking spaces may be deployed. Alternatively, assuming that an average of two people ride in each vehicle, the number of image projection devices 100 deployed may be more than twice the number of parking spaces.
[0096] A charging spot 401 may be installed in the parking lot 400 to charge the image projection device 100 (to supply power to the battery 201) while the image projection device 100 is waiting. The image projection device 100 and the charging spot 401 can constitute an image projection system. The charging spot 401 supplies power to the battery 201 by, for example, wireless power transmission.
[0097] Specifically, charging spot 401, which supplies power wirelessly, is equipped with a transmission coil (not shown) for wireless power supply. The transmission coil is provided in a state where it is not exposed to the outside. This prevents deterioration or breakdown due to water droplets such as rain and dew even when charging spot 401 is installed outdoors. Charging spot 401 corresponding to image projection device 100 equipped with charging contacts is equipped with a terminal that comes into contact with the charging contacts when image projection device 100 is positioned at charging spot 401.
[0098] Each charging spot 401 may supply power to one image projection device 100, or one charging spot 401 may supply power to multiple image projection devices 100 at the same time. The charging spots 401 are installed at locations depending on the number of image projection devices 100 installed in the parking lot 400, the size and shape of the parking lot 400, etc. Specifically, the charging spots 401 may be installed so as to be distributed approximately evenly, for example, as shown in FIG.
[0099] The movement range of the image projection device 100 installed in the parking lot 400 can be, for example, within the parking lot 400 (the space above the parking lot 400: within the range indicated by the dashed line in FIG. 4). Specifically, the movement range of the image projection device 100 can be specified by, for example, a standard area mesh.
[0100] More specifically, the movement range of the image projection device 100 can be specified by, for example, a first mesh, a second mesh, a third mesh, etc. Furthermore, the movement range of the image projection device 100 may also be specified by, for example, a divided area mesh obtained by further subdividing the third mesh, such as a half area mesh, a quarter area mesh, or an eighth area mesh.
[0101] By specifying the movement range of the image projection device 100 using the standard area mesh, it is possible to precisely limit the movement range of the image projection device 100 based on the position information obtained using the GPS receiver 204. Furthermore, by limiting the movement range of the image projection device 100 to within the parking lot 400, where the size and position of passing objects can be predicted, it is possible to reliably avoid accidents caused by the image projection device 100 colliding with unexpected obstacles, for example, and ensure safety.
[0102] In principle, only cars and people are allowed to move within the parking lot 400, so it is possible to precisely limit the moving altitude of the image projection device 100. When the moving unit 307 is realized by the drone 102, the moving altitude of the image projection device 100 can be set appropriately according to the set moving range.
[0103] The range of movement of the image projection device 100 is not limited to the parking lot 400, and the range of movement of the image projection device 100 can be set arbitrarily. The range of movement of the image projection device 100 may be, for example, an event venue, a park, a tourist facility, a tourist spot, a residential area, etc. In any case, the movement range of the image projection device 100 can be specified by the standard area mesh.
[0104] For example, the image projection device 100 constantly moves within the parking lot 400 and detects the presence or absence of a viewer. When the image projection device 100 detects a viewer, it approaches the viewer and starts projecting an image. For example, the image projection device 100 may be made to wait at a charging spot 401, and when the image projection device 100 detects a viewer, it approaches the viewer and starts projecting an image.
[0105] In a parking lot 400 where a plurality of image projection devices 100 are installed, each image projection device 100 detects whether or not there is another image projection device 100 within a predetermined range from the image projection device 100 itself. The other image projection device 100 can be detected, for example, based on the detection results of a human presence sensor 104 (such as an infrared sensor) or an image captured by a camera 103. Alternatively, the image projection devices 100 may communicate with each other and mutually transmit their current locations to detect whether or not there is another image projection device 100 within a predetermined range from the image projection device 100 itself. By detecting whether or not there is another image projection device 100 within a predetermined range from the image projection device 100 itself, collisions between the image projection devices 100 can be avoided.
[0106] 5, the image projection device 100 projects the image 502 from behind the viewer 501 to a position in front of the viewer 501. This allows the image 502 to be projected without interfering with the movement of the viewer 501. Furthermore, the image projection device 100 projects the image 502 from a position higher than the viewer 501. This allows the image 502 to be projected without being cut off even if the viewer 501 makes a sudden movement.
[0107] For example, image projection device 100 projects image 502 at a predetermined angle relative to the horizontal direction. If image 502 is projected onto the ground at a predetermined angle relative to the horizontal direction, projected image 502 will be distorted into a trapezoid. Therefore, image projection device 100 corrects image 502 so that there is no distortion at the projection position.
[0108] Furthermore, when projecting the image 502, the image projection device 100 may, for example, adjust the attitude of the projector 101 relative to the drone 102 while keeping the attitude of the drone 102 horizontal. Specifically, for example, the image projection device 100 may project the image 502 vertically downward from a position in front of the viewer 501 in the direction of movement and higher than the viewer 501, while keeping the attitude of the drone 102 horizontal.
[0109] (Example of processing procedure of image projection device 100) Next, a description will be given of an example of a processing procedure of the image projection device 100. Fig. 6 is a flowchart showing an example of a processing procedure of the image projection device 100. In the flowchart of Fig. 6, first, it is determined whether or not a viewer 501 has been detected (step S601).
[0110] In step S601, for example, the presence or absence of a viewer 501 around the image projection device 100 is determined using the motion sensor 104 or the camera 103. In step S601, the presence or absence of a viewer 501 is detected, and if a viewer 501 is detected, it may also be possible to detect whether the viewer 501 has moved.
[0111] In step S601, if a viewer 501 is detected (step S601: Yes), the image 502 is projected around the viewer 501 (step S602), and the image 502 is projected around the viewer 501 (step S603). In step S603, for example, the image 502 is projected onto the feet (ground, floor, etc.) of the viewer 501. Also, in step S603, for example, if movement of the viewer 501 is detected, the image 502 is projected forward in the direction of movement of the viewer 501. Also, in step S603, for example, if movement of the viewer 501 is detected, the image 502 is projected onto a wall or the like located forward in the direction of movement of the viewer 501. 02. The image may be projected in a ring around the viewer 501.
[0112] Furthermore, in step S603, while projecting the image 502, sound may be output from the speaker 207. By outputting sound, the attention of the viewer 501 can be attracted, and the projected image can be more reliably seen by the viewer 501.
[0113] Next, it is determined whether the quality of the image projected in step S603 is good (step S604). In step S604, for example, the image projected by the image projection unit 303 is compared with the image captured by the capture unit 304, and it is determined whether the quality of the projected image is good based on whether the deviations in the shapes of the outer frames of the images and the objects, colors, contrasts, etc. in the captured images are within predetermined thresholds.
[0114] If the image condition is good in step S604 (step S604: Yes), the process proceeds to step S606. On the other hand, if the image condition is not good in step S604 (step S604: No), the image condition is adjusted (step S605). The processes of steps S604 and S605 are repeated while the image 502 is being projected.
[0115] In step S605, for example, based on the image projected by the image projection unit 303 and the image captured by the image capture unit 304, the image state is adjusted by moving to a position where the image quality of the image captured by the image capture unit 304 is within an acceptable range relative to the image projected by the image projection unit 303, while keeping the position where the image is projected on the ground, floor, wall, etc. constant.
[0116] Also, in step S605, for example, based on the image projected by the image projection unit 303 and the image captured by the image capture unit 304, the image state may be adjusted by moving the position where the image is projected on the ground, floor, wall, etc. until the image quality of the projected image falls within an acceptable range.
[0117] In either method for adjusting the image state, the position of the viewer 501 is detected constantly or at regular intervals, and the image 502 is projected within the range visible to the viewer 501. If it is difficult to maintain a good image state and adjust the projection position of the image on the ground, floor, wall, etc., which changes as the viewer 501 moves, for example, then priority may be given to adjusting the projection position of the image in accordance with the movement of the viewer 501 over maintaining the image state. Alternatively, if it is difficult to achieve both, priority may be given to maintaining a good image state over adjusting the projection position of the image in accordance with the movement of the viewer 501, and the image 502 may be projected at a position slightly away from the viewer 501.
[0118] Also, while the image 502 is being projected, the situation around the viewer 501 detected in step S601: Yes is detected (step S606). In step S606, for example, the human presence sensor 104 (infrared sensor) or the camera 103 is used to detect the situation around the viewer 501. Then, based on the situation around the viewer 501 detected in step S606, it is determined whether or not there are obstacles, etc. around the viewer 501 (step S607). In step S607, for example, it is determined whether or not there are obstacles, such as vehicles, signs, cones, fences, people other than the viewer 501, moving vehicles, etc., within a predetermined range centered on the target viewer 501. If there are no obstacles, etc. around the viewer 501 in step S607 (step S607: No), the process proceeds to step S606, and detection of the situation around the viewer 501 continues.
[0119] In step S607, if there is an obstacle or the like around the viewer 501 (step S607: Yes), it is determined whether or not a warning is required (step S608). In step S608, it is determined whether or not a warning is necessary based on, for example, whether the detected obstacle is present ahead in the direction of movement of the viewer 501, or whether another person or a moving vehicle is approaching the viewer 501. If a warning is not necessary in step S608 (step S608: No), the process proceeds to step S606, and detection of the situation around the viewer 501 continues.
[0120] In step S608, if a warning is necessary (step S608: Yes), a warning image 502 is projected (step S609). In step S609, for example, the warning image may be projected by superimposing it on a part of the image being projected, or the image being projected may be reduced and the warning image 502 may be projected in the remaining area. This ensures the reliability of the advertisement display performance for the advertiser.
[0121] Alternatively, in step S609, for example, the image being projected may be switched to project an attention-calling image 502. This reliably notifies the viewer 501 that there is a change in the situation around the viewer 501, and the viewer 501 can be directed to the situation around the viewer 501 from the image, thereby ensuring the safety of the viewer 501.
[0122] In step S609, the attention-calling image 502 is projected, and an attention-calling sound or a warning sound such as a buzzer or alarm sound may be output from the speaker 207. Outputting such a sound attracts the attention of the viewer 501, and makes the viewer 501 more reliably aware that a disaster may occur within a predetermined time from the present time.
[0123] Then, it is determined whether or not a warning is no longer necessary (step S610). In step S610, it is determined whether or not a warning is no longer necessary based on whether or not there are any obstacles such as vehicles, signs, cones, or fences, or any other person other than the viewer 501, or any moving vehicle, etc., within a predetermined range centered on the target viewer 501.
[0124] In step S610, if the warning is not no longer necessary, that is, if the warning is still necessary (step S610: No), the warning image 502 continues to be projected (step S609). On the other hand, in step S610, if the warning is no longer necessary (step S610: Yes), the projection of the warning image is stopped, and the image 502 is projected (step S611).
[0125] In step S611, for example, an arbitrary image 502 is projected based on image information stored in memory. Alternatively, in step S611, if there is an image whose projection was interrupted in step S609, the projection of the interrupted image may be resumed. This allows the entire advertisement to be projected, ensuring the advertiser's reliability in the display performance of the advertisement.
[0126] Then, it is determined whether the boundary of the movement range set in the image projection device 100 has been exceeded (step S612), and if the boundary of the movement range has not been exceeded (step S612: No), the process proceeds to step S611 and image projection continues. On the other hand, if the boundary of the movement range set in the image projection device 100 has been exceeded in step S612 (step S612: Yes), the image projection device 100 moves into the movement range (step S613) and projects the image 502 within the movement range.
[0127] When the object moves into the movement range, the projection of the image 502 that has been performed until the boundary of the movement range is crossed may be stopped, or the projection of the image 502 may be continued. If the boundary of the movement range is exceeded in step S612: Yes, the robot may move to the charging spot 401. In this case, if another viewer 501 is detected within the movement range during the movement to the charging spot 401, the image 502 may be projected onto the other viewer 501.
[0128] In step S601, if the viewer 501 is not detected (step S601: No), it is determined whether or not a situation related to a disaster or the like has been detected (step S614). In step S614, for example, it is determined based on information acquired from an external device via the communication I / F 203 whether or not a disaster such as an earthquake, lightning strike, or sudden heavy rain will occur within a predetermined time from the present time.
[0129] If the occurrence of a situation related to a disaster or the like is not detected in step S614 (step S614: No), the process proceeds to step S601 to determine whether or not a visual person 501 has been detected. On the other hand, if the occurrence of a situation related to a disaster or the like is detected in step S614 (step S614: Yes), even if a visual person 501 has not been detected, the process moves within the parking lot 400 (step S615), proceeds to step S609, and the attention-calling image 502 is projected.
[0130] In this case, in step S609, a warning image 502 is projected to warn that a disaster may occur within a predetermined time from the present time. In this case, the warning image 502 may be projected while moving along a predetermined route in the parking lot 400, or the warning image 502 may be projected around the viewer 501 who is first detected after starting to move in response to the detection of the occurrence of a situation related to a disaster or the like.
[0131] Furthermore, while moving (flying), the image projection device 100 constantly or at predetermined intervals checks the remaining charge of its own battery 201 and its current location, and projects the image 502 with the remaining charge of the battery 201 sufficient to reach an available charging spot 401 or a predetermined charging spot 401. This prevents the battery 201 from running out and falling during the projection of the image 502, thereby ensuring the safety of the viewer 501.
[0132] The charging spot 401 may be equipped with a wireless router for wireless communication such as Wi-Fi. This allows each image projection device 100 to communicate via a nearby wireless router. Furthermore, by each of the multiple charging spots 401 being equipped with a wireless router, a good communication environment can be ensured.
[0133] Furthermore, charging spot 401 may be equipped with a human presence sensor 104. With this, only when a viewer 501 is detected, image projection device 100 can be moved from charging spot 401 and image 502 can be projected onto viewer 501.
[0134] In an environment where there are multiple image projection devices 100 with overlapping movement ranges, such as a parking lot 400 where multiple image projection devices 100 are deployed, if the remaining charge in the battery 201 of the image projection device 100 runs low while projecting an image 502 and it becomes necessary to return to the charging spot 401, the image projection device 100 may call another image projection device 100 by communicating with at least one of the other image projection device 100 and the charging spot 401, and the other image projection device 100 may take over and project the image that was being projected.
[0135] This allows the viewer 501 to view, without interruption, images (such as a series of moving images) that require a certain amount of time to be viewed in their entirety. Since images that require a certain amount of time to be displayed (such as a series of moving images) can be viewed without interruption, the reliability of the display performance of advertisements can be ensured for advertisers.
[0136] Furthermore, in an environment where there are multiple image projection devices 100 with overlapping movement ranges, the image 502 may be projected using the multiple image projection devices 100, each displaying a different image. Specifically, for example, the multiple image projection devices 100 may each project images of different regions of a single image (for example, images of the upper right, lower right, upper left, and lower left divided into four), thereby projecting a single image 502 as a whole. This allows a large-sized image 502 to be projected without degrading color, contrast, and the like, compared to when an image of the same size is projected by a single image projection device 100.
[0137] Specifically, for example, an image 502 may be projected in which each pixel in an image projected by each of the multiple image projection devices 100 complements pixels in an image projected by another image projection device 100. This makes it possible to increase the number of pixels in the projected image 502 without increasing the weight or size of the image projection device 100 or reducing the light receiving area of the liquid crystal panel of the projector 101, thereby making it possible to project a high-definition image 502.
[0138] More specifically, for example, a plurality of image projection devices 100 may project the same image 502 at the same location. This allows the projection of an easy-to-view image 502 with clear colors and contrast even in the daytime, without increasing the weight or size of the image projection device 100.
[0139] The image projection device 100 may detect the movement of a viewer 501 of the image 502 projected by the projector 101 based on an image captured by the camera 103, and may switch the projection mode of the image 502 when the viewer 501 makes a predetermined gesture.
[0140] Specifically, for example, when a viewer 501 pinches out, the image 502 is enlarged and projected. The image 502 may be enlarged by increasing the distance from the position where the image 502 is projected to the projector 101, or may be enlarged by each of the multiple image projection devices 100 displaying images of different regions of a single image, as described above.
[0141] In this way, by enlarging and projecting image 502, when an advertisement image 502 including text informing the store name, business hours, special offers, etc., or an image 502 of a product such as clothing or accessories is projected, a viewer 501 who is interested in the image 502 can check the details of the image 502. This allows viewer 501 to check the details of the product included in image 502, for example, and thus further increases the viewer's interest in the product, which can be expected to have a high advertising effect.
[0142] When enlarging image 502, it is possible to project image 502 with additional information that was not included in the pre-enlarged image 502. Specifically, for example, when image 502 of a product such as clothing or accessories is being projected, if the viewer 501 pinches out, it is possible to project image 502 that shows the enlarged product and the price and stock status of the product.
[0143] Also, for example, when the image projection device 100 projects an image 502 of a map from the current position to a store desired by a viewer 501, if the viewer 501 pinches out, In this case, an image 502 including an enlarged map and the names of facilities included in the map may be projected. This allows the viewer 501 to be reliably guided to the desired store.
[0144] Specifically, for example, when a viewer 501 pinches in, the image 502 is reduced and projected. The reduction of the image 502 may be achieved by shortening the distance from the position where the image 502 is projected to the projector 101, or by reducing the size of the image 502 to be projected.
[0145] Alternatively, for example, when the viewer 501 pinches in, a wide-angle image may be projected. Specifically, for example, when the viewer 501 pinches in while projecting a map image 502 from the current position of the image projection device 100 to a store desired by the viewer 501, an image 502 of a map with a wider range is projected. This allows the viewer 501 to grasp his or her current position within the entire facility.
[0146] More specifically, for example, when the viewer 501 performs a predetermined gesture, the image 502 being projected may be switched to another image 502. This allows the viewer 501 to switch the image (video) 502 at any timing, like zapping, and view the image 502 of his / her choice.
[0147] In the above-described embodiment, an example has been described in which the movement range of the image projection device 100 is limited to a parking lot, but the present invention is not limited to this. Any movement range may be set as appropriate, or no movement range may be set. The image projection device 100 is equipped with the projector 101 and the camera 103 as an integrated unit, and therefore can project an image 502 according to the intention of a viewer 501 in any location.
[0148] Specifically, for example, the image 502 can be projected onto a tent outdoors, such as at a campsite. This allows the image 502 to be projected according to the location and intention of the viewer 501, even outdoors where there is no stable support for fixing the projector 101 or a screen or wall onto which to project the image.
[0149] In the above-described embodiment, an example has been described in which the projector 101 is moved by the drone 102 on which the projector 101 is mounted, but the projector 101 is not limited to being moved by the drone 102. For example, in an environment with a ceiling or walls, such as an indoor parking lot, the projector 101 may be mounted on a moving body that moves along the ceiling or wall, and the projector 101 may be moved by the movement of the moving body (see FIG. 7).
[0150] <Another embodiment> Fig. 7 is an explanatory diagram showing an example of an image projection device according to another embodiment of the present invention and an environment in which the image projection device moves. In Fig. 7, the same parts as those in the above-described embodiment are designated by the same reference numerals. As shown in Fig. 7, the image projection device 700 includes a moving body 701. The moving body 701 includes a main body 702, a rolling body 703, a magnet 704, and a slide shoe 705.
[0151] The main body 702 has a generally box-like shape and houses therein a control circuit 202, an antenna, a motor, a battery, etc. The control circuit 202 is configured with a CPU, a memory, etc., and drives and controls each unit of the image projection device 700. Specifically, for example, the control circuit 202 drives and controls a motor 205 connected to a rolling element 703, causing the rolling element 703 to rotate and the image projection device 700 to move.
[0152] The rolling elements 703 are connected to the main body 702 so as to be rotatable (rollable). The rolling elements 703 protrude further from the end faces of the main body 702 toward the ceiling 706 and wall 707. It is preferable that three or more rolling elements 703 are provided. This allows the image projection device 700 to move stably and smoothly.
[0153] Specifically, the rolling element 703 can be realized by, for example, a roller, a ball, or a roll. By using a ball or a roll for the rolling element 703, the turning radius of the moving element 701 can be reduced, making it possible to achieve small turning radius and ensuring a high degree of freedom in movement. When the rolling element 703 is realized by a roller, the toe angle and caster angle are adjusted appropriately.
[0154] The magnet 704 is provided on the same side of the main body 702 as the rolling element 703. The magnet 704 uses its magnetic force to attract the image projection device 100 to the ceiling 706 or the wall 707. The slide shoe 705 has a sheet or flat plate shape. The slide shoe 705 is made of a material that does not impair the magnetic force of the magnet 704 that attracts the image projection device 700 to the ceiling 706 or the wall 707, and that does not provide resistance to movement of the image projection device 100. Specifically, the slide shoe 705 can be made of, for example, hard silicone rubber.
[0155] The slide shoe 705 is provided so that the end face opposite the main body is located at the same position as the tip of the rolling element 703 (the contact position of the rolling element 703 with the ceiling 706 or wall 707) or slightly closer to the main body. This allows the rolling element 703 to be reliably brought into contact with the ceiling 706 or wall 707, and allows the image projection device 100 to be moved smoothly.
[0156] The slide shoe 705 may be provided so as to be able to move toward and away from the magnet 704 or the main body 702. Specifically, for example, the slide shoe 705 may be connected to the magnet 704 or the main body 702 via an elastic member such as a spring. This allows the rolling element 703 to reliably come into contact with the ceiling 706 or the wall 707, allowing the image projection device 100 to move smoothly.
[0157] Such an image projection device 700 may identify its current location using the GPS receiver 204 as described above, but is not limited to this. The image projection device 700 may identify its current location using, for example, the principle of triangulation used in PHS (Personal Handy-phone System). Specifically, for example, a plurality of PHS base stations (not shown) are installed on the ceiling 706 or wall 707, and the location of the device is identified by receiving radio waves output from these base stations via an antenna.
[0158] This makes it possible to identify and control the position of the image projection device 700 with high accuracy even in an environment where it is difficult to receive radio waves from a GPS satellite due to the presence of a ceiling 706 or a wall 707. This makes it possible to project the image 502 at any position within the building. Because the image projection device 700 moves along the ceiling 706 or the wall 707, it is possible to reliably prevent the viewer 501 from colliding with it, ensuring the safety of the viewer 501.
[0159] As described above, the image projection device 100 according to an embodiment of the present invention is characterized by including a projector 101 that projects an image 502, a drone 102 that moves the projector 101, and a control circuit 202 that controls the drone 102 in conjunction with the projection of the image 502 by the projector 101.
[0160] Furthermore, the image projection device 700 according to the embodiment of the present invention is characterized by including a projector 101 that projects an image 502, a moving body 701 that moves the projector 101, and a control circuit 202 that controls the moving body 701 in association with the projection of the image 502 by the projector 101.
[0161] According to the image projection devices 100 and 700 of the embodiments of the present invention, by moving the projector 101 in association with the projection of the image 502 by the projector 101, it is possible to easily and reliably project an image at a desired location without being affected by the environment. Also, according to the image projection devices 100 and 700 of the embodiments of the present invention, it is possible to easily and reliably project a large-sized image at a desired location without being affected by the environment. This allows the viewer 501 to view and enjoy a large-sized image at any location.
[0162] In addition, the image projection devices 100 and 700 according to the embodiments of the present invention are characterized in that they are equipped with a camera 103 that captures the image projected by the projector 101, and that a control circuit 202 controls the drone 102 and the moving body 701 based on the image projected by the projector 101 and the image captured by the camera 103, thereby moving the projector 101.
[0163] According to the image projection devices 100 and 700 of the embodiments of the present invention, if part or all of the projected image 502 is lost during projection of the image 502 due to an obstacle such as a person getting between the location where the image 502 is to be projected and the projector 101, the projector 101 can be moved to a location where the image will not be lost due to the obstacle, thereby ensuring that the image 502 can be projected in the same location without being affected by changes in the environment such as the movement of people or objects.
[0164] Such image projection devices 100 and 700 are suitable for projecting, for example, an advertising image 502 for which the advertiser must pay the advertising fee. By projecting the advertising image 502 using the image projection device 100, the advertising image 502 can be seen by the viewer 501 with a high probability, which improves the reliability of the exposure record of the advertising image 502 and allows the advertiser to expect a high advertising effect.
[0165] Furthermore, the image projection devices 100 and 700 according to the embodiments of the present invention are characterized in that the control circuit 202 detects whether or not there is distortion in the image 502 projected by the projector 101 based on the image captured by the camera 103, and corrects the distortion of the image projected by the projector 101 based on the detection result.
[0166] According to the image projection devices 100 and 700 of the embodiments of the present invention, by correcting the distortion of the image 502 projected by the projector 101, the viewer 501 can view the image 502 without distortion, regardless of the location where the image 502 is projected, thereby preventing the viewer 501 from feeling any discomfort or strangeness.
[0167] Such image projection devices 100, 700 are particularly useful for projecting images containing letters, numbers, maps, etc., to any location, and can reliably convey the guidance provided by the projected image 502 to the viewer 501, even when projecting letters, etc., onto uneven ground or a wall surface, for example.
[0168] Furthermore, the image projection devices 100 and 700 according to the embodiments of the present invention include a viewer detection unit 305 such as a human sensor 104 and a camera 103 that detects a viewer 501 who sees an image projected by the projector 101, and the control circuit 202 controls the drone 102 and the moving body 701 based on the detection result of the viewer detection unit 305, and moves the projector 101. It is characterized by its ability to
[0169] According to the image projection devices 100 and 700 of the embodiments of the present invention, the location where the image 502 is projected can be changed by moving the projector 101 based on the detection results of the viewer detection unit 305, so that the image 502 projected by the projector 101 can be reliably viewed by the viewer 501.
[0170] In addition, the image projection devices 100 and 700 according to the embodiments of the present invention are characterized in that they include a situation detection unit 306 such as a human sensor 104 or a camera 103 that detects the situation around the viewer 501, and the control circuit 202 switches the image projected by the projector 101 based on the detection result of the situation detection unit 306.
[0171] According to the image projection devices 100 and 700 of the embodiments of the present invention, the image 502 projected by the projector 101 can be switched depending on the surrounding conditions of the viewer 501, allowing the viewer 501 to view an image 502 that is suitable for the viewer 501.
[0172] Specifically, for example, when it is detected that a vehicle has entered within a predetermined range of the viewer 501, the image 502 that was projected before the detection is replaced with an image 502 that warns the viewer 501 of the approaching vehicle and of an accident that may occur due to the approaching vehicle, thereby preventing the viewer 501 from concentrating on the image 502 and losing attention to the surroundings, thereby preventing an accident from occurring.
[0173] In addition, specifically, for example, if a sudden change in the weather or the occurrence of an earthquake is detected in the location where the viewer 501 is located, the image 502 that was projected before the detection can be replaced with an image 502 that indicates the possibility of a sudden change in the weather or urges the viewer 501 to evacuate to a safe place, thereby allowing the viewer 501 to prepare for the occurrence of an unforeseen event.
[0174] Furthermore, the image projection devices 100 and 700 of the embodiments of the present invention are characterized in that the control circuit 202 detects the movement of the viewer 501 based on the detection results of the viewer detection unit 305, controls the drone 102 or the moving body 701 to project the image 502 forward in the direction of movement of the viewer 501, and moves the projector 101.
[0175] According to the image projection devices 100 and 700 of the embodiments of the present invention, the projector 101 is moved so as to project the image 502 in front of the moving viewer 501 in the direction of movement, and thus the location where the image 502 is projected can be changed according to the movement of the viewer 501, so that the viewer 501 can reliably view the image 502 projected by the projector 101 without interfering with the movement of the viewer 501.
[0176] Such image projection devices 100, 700 are suitable for projecting images that guide the user 501, who is a user of the facility, in the direction of movement, for example, in leisure lands such as theme parks, shopping malls, or large parking lots 400 attached to these facilities, and that provide advertisements and information about benefits of attractions, stores, etc. located ahead, or images that guide the location of the attractions, stores, etc. or the route to the attractions or stores.
[0177] Alternatively, such image projection devices 100, 700 may project, for example, an image that provides information about advertisements or benefits for attractions, stores, etc. that are located in a direction different from the direction of movement of the viewer 501 (for example, behind), or an image 502 that provides information about the location of the attraction, store, etc. or the route to the attraction or store.
[0178] By projecting these images 502 using the image projection devices 100 and 700, This allows information about attractions, stores, etc. to be conveyed without interfering with the movement of the viewer 501, thereby improving convenience for the viewer 501. Furthermore, compared to advertisements that are set up in fixed locations, information about attractions, stores, etc. can be viewed by the viewer 501 for a long period of time, so advertisers can expect a high advertising effect.
[0179] Furthermore, the image projection devices 100 and 700 according to the embodiments of the present invention are characterized in that they include a situation detection unit 306 such as a human presence sensor 104 or a camera 103 that detects the situation ahead in the direction of movement of the viewer 501, and the control unit 301 switches the image projected by the image projection unit based on the detection result of the situation detection unit 306.
[0180] According to the image projection devices 100 and 700 of the embodiments of the present invention, the image 502 projected by the projector 101 can be switched depending on the situation in front of the viewer 501, thereby providing useful information that is in line with the movement of the viewer 501.
[0181] Specifically, for example, if there is an obstacle to the movement of a person, vehicle, or the like in front of the viewer 501, it is possible to prevent an accident from occurring due to the viewer 501 continuing to move aimlessly while concentrating on the image 502.
[0182] The image projection method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, CD-ROM, MO, DVD, USB memory, or SSD, and is executed by being read from the recording medium by the computer. This program may also be a transmission medium that can be distributed via a network such as the Internet. [Industrial Applicability]
[0183] As described above, the image projection device according to the present invention is useful as an image projection device that projects an image, and is particularly suitable as an image projection device that moves and projects an image. [Explanation of symbols]
[0184] 100 Image projection device 101 Projector 102 Drone 103 Camera 104 Human Sensor 400 Parking 401 Charging Spot 501 Sighted 502 images
Claims
1. an image projection unit that projects an image; a moving unit that moves the image projection unit; a control unit that controls the moving unit in association with the projection of an image by the image projection unit; An image projection device comprising:
2. a photographing unit that photographs the image projected by the image projection unit, The image projection device according to claim 1 , wherein the control unit controls the movement unit based on the image projected by the image projection unit and the image captured by the image capture unit, thereby moving the image projection unit.
3. The image projection device according to claim 2, characterized in that the control unit detects whether or not the image projected by the image projection unit is distorted based on the image captured by the imaging unit, and corrects distortion of the image projected by the image projection unit based on the detection result.
4. a viewer detection unit that detects a viewer who views the image projected by the image projection unit, The image projection device according to any one of claims 1 to 3, characterized in that the control unit controls the movement unit based on the detection result of the viewer detection unit to move the image projection unit.
5. a situation detection unit that detects a situation around the viewer, The image projection device according to claim 4 , wherein the control unit switches the image projected by the image projection unit based on the detection result of the situation detection unit.
6. The image projection device described in claim 4 or 5, characterized in that the control unit detects the movement of the viewer based on the detection result of the viewer detection unit, controls the movement unit to project an image forward in the direction of the viewer's movement, and moves the image projection unit.
7. a situation detection unit that detects a situation ahead in a moving direction of a viewer who views the image projected by the image projection unit, 7. The image projection device according to claim 1, wherein the control unit switches the image projected by the image projection unit based on the detection result of the situation detection unit.
Citation Information
Patent Citations
Automatic movement type air floating image display device
JP2005338114A
Aircraft-based image projection method, apparatus and aircraft
JP2017521704A
Methods and Apparatus for Inventory and Price Information Management
US20090094140A1
Video display system
JP2018125816A