Projection system, projection method, and program

Abstract

To enhance the sense of immersion in the projected image. [Solution] A projection system comprising: a projection target supported so as to be swingable on a support; a projector that projects an image onto the projection target; a first sensor capable of detecting people around the projection target; a second sensor capable of detecting the swinging of the projection target; and a computer that, when it detects the people based on the detection result of the first sensor and detects the swinging of the projection target based on the detection result of the second sensor, causes the projector to change the projection mode of the image.

Description

Technical Field

[0005]

[0001] The present invention relates to a projection system, a projection method, and a program.

Background Art

[0002] Conventionally, in entertainment facilities such as aquariums, there is an experience-type facility in which an image projected by a projector is displayed on a projection target such as a transparent screen suspended in a passage, and users can enjoy a visual experience when they touch, enter, or pass through the screen.

[0003] Patent Document 1 discloses an image display system that projects an image on a curtain suspended by a hanging member spanned between two frames.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In a conventional image display system, when a user touches, enters, or passes through the screen, there is no change in the image projected by the projector, and there is room for improvement in enhancing the immersive feeling that focuses the user's attention on the visual experience.

Means for Solving the Problems

[0006] One aspect of the present disclosure is a projection system comprising: a projection object pivotably supported on a support; a projector for projecting an image onto the projection object; a first sensor capable of detecting people around the projection object; a second sensor capable of detecting the movement of the projection object; and a computer that, when it detects the person based on the detection result of the first sensor and detects the movement of the projection object based on the detection result of the second sensor, causes the projector to change the projection mode of the image.

[0007] Another aspect of the present disclosure is a projection method in which a computer detects a person based on the detection result of a first sensor capable of detecting a person around a projection target that is pivotably supported on a support, and detects the pivoting of the projection target based on the detection result of a second sensor capable of detecting the pivoting of the projection target, and instructs a projector that projects an image onto the projection target to change the projection mode of the image.

[0008] A further aspect of the present disclosure is a program that causes a computer to detect a person based on the detection result of a first sensor capable of detecting a person around a projection object that is pivotably supported on a support, and to cause a projector that projects an image onto the projection object to change the projection mode of the image when it detects a person based on the detection result of a second sensor capable of detecting the pivot of the projection object. [Brief explanation of the drawing]

[0009] [Figure 1] An explanatory diagram illustrating the installation overview of the projection system. [Figure 2] A block diagram showing an example configuration of an information processing device. [Figure 3] A flowchart illustrating an example of the projection system's operation. [Figure 4] An explanatory diagram showing an example of a projection mode of a projection system. [Modes for carrying out the invention]

[0010] Embodiments relating to this disclosure will be described in detail below with reference to the drawings. However, some descriptions may be omitted to avoid unnecessary detail. For example, detailed explanations of already well-known matters or redundant explanations of substantially identical configurations may be omitted.

[0011] Furthermore, this disclosure may use common abbreviations. For example, HDMI is an abbreviation for High-Definition Multimedia Interface. Note that HDMI is a registered trademark. USB is an abbreviation for Universal Serial Bus. PC is an abbreviation for Personal Computer. ROM is an abbreviation for Read Only Memory. RAM is an abbreviation for Random Access Memory. HDD is an abbreviation for Hard Disk Drive. SSD is an abbreviation for Solid State Drive. CPU is an abbreviation for Central Processing Unit. MPU is an abbreviation for Micro Processing Unit. SoC is an abbreviation for System-on-a-Chip. DSP is an abbreviation for Digital Signal Processor. LiDAR is an abbreviation for Light Detection And Ranging.

[0012] Figure 1 is an explanatory diagram illustrating the installation overview of a projection system according to an embodiment. As shown in Figure 1, the projection system 100 is installed in a passageway 110 or the like within a facility. The projection system 100 includes a projection target 3, a first projector 2A, a second projector 2B, a camera 6, a vibration sensor 9, and an information processing device 1.

[0013] The projection object 3 is, for example, a translucent cylindrical curtain. The projection object 3 is suspended by a suspension member 4 provided on the ceiling 112 of the passageway 110 so as not to come into contact with the floor 111 and the wall 113. The suspension member 4 is an example of a support, and the projection object 3 is supported by the suspension member 4 so as to be able to swing.

[0014] For example, if a person 200 using the facility touches, enters, or passes through the projection target 3 while walking through the corridor 110, the projection target 3 will be shaken by the actions of this person 200.

[0015] In this embodiment, a projection target 3 that is suspended in a swingable manner is illustrated, but the configuration of the swingable projection target 3 is not limited to the suspended type described above. For example, the projection target 3 may be swingably supported by a bendable pole that is standing upright from the floor 111. Also, the projection target 3 may be an opaque curtain, and may be a flat curtain rather than a cylindrical hanging curtain. Furthermore, the projection target 3 may consist of not just one curtain, but multiple curtains. For example, the projection target 3 may be configured with multiple curtains arranged in concentric circles.

[0016] The direction of oscillation D1 of the projection target 3 is restricted by a restricting member 5 that restricts the oscillation of the projection target 3 on the suspension member 4 in a predetermined direction. For example, the restricting member 5 may be a rail member that restricts the oscillation direction of the projection target 3 suspended by the suspension member 4 to one direction. As an example, the restricting member 5 is perpendicular to the direction of extension of the passage 110 from front to back and restricts the oscillation direction D1 of the projection target 3 toward the left and right walls 113. More specifically, the restricting member 5 restricts the oscillation direction D1 of the projection target 3 so as to coincide with the optical axis directions of the first projector 2A and the second projector 2B, which will be described later.

[0017] The first projector 2A and the second projector 2B, under the control of the information processing device 1, project first image light 7A and second image light 7B toward the projection target 3, thereby projecting first image 8A and second image 8B. Unless otherwise specified, the first projector 2A and the second projector 2B will be referred to as projector 2. Unless otherwise specified, the first image light 7A and the second image light 7B will be referred to as image light 7. Unless otherwise specified, the first image 8A and the second image 8B will be referred to as image 8.

[0018] The projector 2 includes, for example, a liquid crystal light valve for projecting an image, a projection lens, a liquid crystal drive unit, an ultra-high pressure mercury lamp as a light source, and a speaker. The projector 2 is communicably connected to the information processing device 1, for example, by a cable. The projector 2 acquires image data representing an image to be projected onto the projection target 3 and audio data to be output from the speaker from the information processing device 1 through communication via the cable. The projector 2 projects the image indicated by the acquired image data onto the projection target 3. In addition, the projector 2 outputs audio such as sound effects indicated by the acquired audio data from the speaker.

[0019] The communication between the projector 2 and the information processing device 1 is, for example, wired communication compliant with standards such as HDMI, DisplayPort, or USB Type-C. The communication between the projector 2 and the information processing device 1 may also be wireless communication compliant with standards such as Wi-Fi. Note that Wi-Fi is a registered trademark.

[0020] The first projector 2A and the second projector 2B project the first image light 7A and the second image light 7B toward the projection target 3 suspended from the left and right wall 113 sides to the center of the passage 110, respectively. Thereby, the first projector 2A and the second projector 2B project the first image 8A and the second image 8B. Specifically, the first projector 2A is provided on the left wall 113 side and projects the first image light 7A onto the projection target 3 suspended from the left wall 113 side to the center of the passage 110, thereby projecting the first image 8A. Conversely, the second projector 2B is provided on the right wall 113 side and projects the second image light 7B onto the projection target 3 suspended from the right wall 113 side to the center of the passage 110, thereby projecting the second image 8B. That is, the optical axes of the first image light 7A and the second image light 7B projected by the first projector 2A and the second projector 2B are orthogonal to the extending direction of the passage 110 from the front to the back and coincide with the swinging direction D1 of the projection target 3 toward the left and right walls 113.

[0021] In addition, the first image 8A projected from the first projector 2A onto the projection target 3 is projected not only onto the surface of the projection target 3 but also onto the right wall 113 as a shadow through the transparent projection target 3. Similarly, the second image 8B projected from the second projector 2B onto the projection target 3 is projected not only onto the surface of the projection target 3 but also onto the left wall 113 as a shadow through the projection target 3. A person 200 in the passage 110 can enjoy the visual experience by the first image 8A and the second image 8B of such a surface of the projection target 3 and the shadow through the projection target 3.

[0022] The camera 6 is a digital camera that photographs the periphery of the projection target 3. For example, the camera 6 is installed under the first projector 2A or the like so as to image the direction of the projection target 3. The camera 6 is communicably connected to the information processing apparatus 1 by wire or wirelessly, similar to the projector 2 described above. The camera 6 outputs the captured image data to the information processing apparatus 1 by communicating with the information processing apparatus 1.

[0023] The vibration sensor 9 is installed, for example, on the suspension member 4 or the like and detects the swing of the projection target 3. Specifically, the vibration sensor 9 detects the frequency and the amplitude of the vibration generated by the swing of the projection target 3. The vibration sensor 9 is communicably connected to the information processing apparatus 1 by wire or wirelessly similar to the projector 2 and the camera 6 described above. The vibration sensor 9 outputs detection data indicating the detected frequency and amplitude to the information processing apparatus 1 by communicating with the information processing apparatus 1.

[0024] The information processing apparatus 1 is an example of a computer that controls the operation of the projector 2, and for example, a PC or the like can be applied. FIG. 2 is a block diagram showing a configuration example of the information processing apparatus 1.

[0025] As shown in FIG. 2, the information processing apparatus 1 includes a control unit 10 and a communication unit 40. In addition to the control unit 10 and the communication unit 40 described above, the information processing apparatus 1 may include a display unit such as a display for display, an operation unit such as a mouse and a keyboard, and the like.

[0026] The control unit 10 includes a storage unit 20 and a processor 30. The storage unit 20 includes, for example, non-volatile memory such as ROM and volatile memory such as RAM. The storage unit 20 may also be configured to include auxiliary storage devices such as HDDs and SSDs.

[0027] The storage unit 20 stores a program 21 that controls the operation of each part of the information processing device 1, content data 22, and various setting information in a non-volatile memory or auxiliary storage device. The volatile memory of the storage unit 20 is used as a work area when the processor 30 executes the program 21.

[0028] Content data 22 is data relating to content such as videos, still images, and documents to be projected from projector 2. For example, content data 22 includes image data such as videos, still images, and documents, as well as audio data such as sound effects and background music to be played during projection. In addition, content data 22 includes multiple types of content so that the content projected from projector 2 can be switched depending on the situation.

[0029] For example, the content data 22 may include content for projection under normal circumstances and content for projection when the projection target 3 is shaken, such as when a person 200 touches, enters, or passes through the projection target 3.

[0030] To give an example of content projected in amusement facilities such as aquariums, the content projected under normal circumstances might be a video of a school of tropical fish swimming slowly, along with background music for that video playback. In addition, the content projected when the projection target 3 is swaying might be a video of the swimming school of tropical fish gathering towards the projection target 3, along with background music for that video playback.

[0031] The processor 30 is an arithmetic processing unit such as a CPU or MPU. The processor 30 may consist of a single arithmetic processing unit or multiple arithmetic processing units. The processor 30 may also consist of part or all of the memory unit 20 or an SoC integrated with other circuits. The processor 30 may also consist of a combination of a CPU that executes the program 21 and a DSP that performs predetermined arithmetic processing. Furthermore, the processor 30 may be configured with all its functions implemented in hardware, or it may be configured using a programmable device.

[0032] The communication unit 40 is a communication interface that communicates with external devices such as the projector 2, camera 6, and vibration sensor 9. For example, the communication unit 40 has a wireless antenna and communication circuit for wireless communication compliant with standards such as Wi-Fi. The communication unit 40 also has terminals and interface circuits for wired communication compliant with standards such as HDMI, DisplayPort, and USB Type-C.

[0033] The processor 30 reads the program 21 from the storage unit 20 and executes it sequentially, thereby providing the functions of a human detection unit 31, a motion detection unit 32, and a projection control unit 33.

[0034] The person detection unit 31 is a processing unit that detects people 200 around the projection target 3 based on image data of the projection target 3 captured by the camera 6. Specifically, the person detection unit 31 detects people 200 around the projection target 3 by performing image analysis of the image data captured by the camera 6 using known image recognition technology.

[0035] In other words, camera 6 is an example of a sensor capable of detecting people 200 around the projection target 3. Note that the sensor capable of detecting people 200 around the projection target 3 is not limited to camera 6. For example, the sensor capable of detecting people 200 around the projection target 3 could be an ultrasonic sensor, a near-infrared camera, LiDAR, etc.

[0036] The oscillation detection unit 32 is a processing unit that detects the oscillation of the projection target 3 based on the detection results of the vibration sensor 9. Specifically, the oscillation detection unit 32 detects the oscillation of the projection target 3 based on the frequency and amplitude included in the detection data acquired from the vibration sensor 9.

[0037] In other words, the vibration sensor 9 is an example of a sensor capable of detecting the oscillation of the projection target 3. The oscillation detection unit 32 may also detect the oscillation of the projection target 3 by performing image analysis of image data captured by the camera 6 using known image recognition technology. In other words, the sensor capable of detecting the oscillation of the projection target 3 may be the camera 6.

[0038] For example, the oscillation detection unit 32 identifies the image region of the projection target 3 frame by frame from the image data captured by the camera 6. Then, the oscillation detection unit 32 detects the oscillation of the projection target 3 by determining the amount of movement between frames for the image region of the projection target 3 identified frame by frame.

[0039] Furthermore, if the oscillation detection unit 32 detects oscillation of the projection target 3 based on the detection result of the vibration sensor 9, it estimates whether or not the projection target 3 has oscillated due to the movement of the person 200 based on the detection result of the camera 6, i.e., the image data captured by the camera 6.

[0040] For example, the motion detection unit 32 performs image analysis on the image data captured by the camera 6 to determine the movements of people 200 around the projection target 3. As an example, the motion detection unit 32 inputs the image data captured by the camera 6 into a classification model that estimates the movement of an object from the features of the image, thereby determining the movements of people 200 included in the image data. Then, if the determined movement of people 200 is a predetermined movement related to the projection target 3, the motion detection unit 32 estimates that the projection target 3 has oscillated due to the movement of people 200. Predetermined movements related to the projection target 3 include, for example, touching the projection target 3 with hands or feet, or fanning the projection target 3 with hands.

[0041] The projection control unit 33 is a processing unit that controls projection by the projector 2. Specifically, the projection control unit 33 reads content data 22 from the storage unit 20 and acquires image data and audio data of the content to be projected. Then, the projection control unit 33 outputs the acquired image data and audio data of the content, along with control signals indicating the control content for projection, to the projector 2.

[0042] Furthermore, the projection control unit 33 changes the projection mode of the projector 2 based on the detection results of the person detection unit 31 and the oscillation detection unit 32. Here, changing the projection mode of the projector 2 includes switching the image 8 that the projector 2 projects. Specifically, the projection control unit 33 switches the image 8 that the projector 2 projects by switching the content to be projected when reading the content data 22.

[0043] Furthermore, changing the projection mode of projector 2 includes switching the image light 7 applied to image 8. Specifically, the projection control unit 33 switches the content output to projector 2 regarding the control content related to image light 7, such as the light intensity, color, and projection range of image light 7, thereby switching the image light 7 projected by projector 2.

[0044] Furthermore, changing the projection mode of Projector 2 includes switching the audio output when Projector 2 projects. Specifically, the projection control unit 33 switches the content output to Projector 2 regarding control content related to audio output, such as volume and sound effects, thereby switching the audio output from Projector 2's speaker.

[0045] The changes in the projection mode of Projector 2 may be a combination of the changes described above. For example, when changing the projection mode of Projector 2, the content may be switched, as well as the light intensity, color, projection range, etc. of the image light 7, and the volume may be switched.

[0046] For example, the projection control unit 33 changes the projection mode of the projector 2 based on the detection result of the person detection unit 31, specifically whether or not it has detected people 200 around the projection target 3. As an example, if the projection control unit 33 detects people 200 around the projection target 3, it changes the projection mode to increase the light intensity of the image light 7 and the volume of the sound output compared to when people 200 are not detected. This allows the projection system 100 to attract the attention of people 200 around the projection target 3 to the projection by the projector 2.

[0047] Furthermore, the projection control unit 33 detects people 200 around the projection target 3 based on the detection results of the person detection unit 31 and the oscillation detection unit 32, and changes the projection mode of the projector 2 if it detects oscillation of the projection target 3.

[0048] Here, the projection mode of projector 2 before detection is referred to as the first projection mode. The projection mode changed after detection is referred to as the second projection mode. That is, if the projection control unit 33 detects people 200 around the projection target 3 and also detects movement of the projection target 3, it will change the projection mode of projector 2 from the first projection mode to the second projection mode. This change from the first projection mode to the second projection mode may be the changes described above or a combination thereof.

[0049] As an example, in the first projection mode, the projection control unit 33 reads the content to be projected from the content data 22 and projects it from the projector 2. In the second projection mode, the projection control unit 33 reads the content to be projected when the projection target 3 is oscillating from the content data 22 and projects it from the projector 2.

[0050] Furthermore, in the second projection mode, the projection control unit 33 may switch the image light 7, such as increasing the light intensity and projection range of the image light 7, or making the colors of the image light 7 more vivid, compared to the first projection mode.

[0051] Furthermore, the projection control unit 33 may switch the sound output from the projector 2's speaker, such as increasing the volume of the sound output in the second projection mode compared to the first projection mode.

[0052] Furthermore, the projection control unit 33 may combine the above-described changes when switching from the first projection mode to the second projection mode. For example, the projection control unit 33 may switch to the content to be projected when the projection target 3 is shaken, and may also increase the light intensity and projection range of the image light 7.

[0053] As a result, in the projection system 100, the projection mode of the projector 2 changes when a person 200 touches, enters, or passes through the projection object 3, thereby inducing the person 200 to focus their attention on the projection by the projector 2. Furthermore, by changing the projection mode in this way, the projection system 100 can enhance the sense of immersion, causing the person 200 to concentrate their attention on the visual experience.

[0054] Figure 3 is a flowchart showing an example of the operation of the projection system 100. As shown in Figure 3, when processing starts, the projection control unit 33 reads the content to be projected from the content data 22 and starts projection of the projector 2 in the first projection mode (S1).

[0055] Next, the projection control unit 33 determines whether or not it has detected a person 200 in the vicinity of the projection target 3 based on the detection result of the person detection unit 31 (S2). If no person 200 is detected (S2: No), the projection control unit 33 waits for processing and continues projection of the projector 2 in the first projection mode.

[0056] If person 200 is detected (S2: Yes), the projection control unit 33 determines whether or not it has detected oscillation of the projection target 3 based on the detection result of the oscillation detection unit 32 (S3). If oscillation with the projection target 3 is not detected (S3: No), the projection control unit 33 returns to S2 and continues projection of the projector 2 in the first projection mode.

[0057] If oscillation of the projection target 3 is detected (S3: Yes), the projection control unit 33 changes the projection by the projector 2 to the second projection mode (S4).

[0058] Here, the detection of oscillation of the projection target 3 may be the detection of whether or not the projection target 3 has oscillated due to the movement of person 200. Specifically, the projection control unit 33 detects oscillation of the projection target 3 when the oscillation detection unit 32 estimates, based on the image data captured by the camera 6, that the projection target 3 has oscillated due to the movement of person 200.

[0059] Next, the oscillation detection unit 32 identifies the amplitude and frequency of the oscillation of the projection target 3 from the detection data of the vibration sensor 9 (S5). Then, the projection control unit 33 performs projection and sound effects for the second projection mode according to the amplitude and frequency identified by the oscillation detection unit 32 (S6).

[0060] Specifically, the projection control unit 33 changes the projection mode of the projector 2 according to the specified amplitude and frequency. For example, the projection control unit 33 changes the light intensity, projection range, and saturation of the image light 7 in the projector 2 according to the magnitude of the amplitude and frequency. The projection control unit 33 also changes the volume of sound output such as sound effects in the projector 2 according to the magnitude of the amplitude and frequency. Furthermore, the projection control unit 33 may change the projection mode of the projector 2 in synchronization with the period of vibration at the amplitude and frequency. Moreover, the change in the projection mode of the projector 2 only needs to be based on at least one of the amplitude and frequency.

[0061] Next, the projection control unit 33 determines, based on the detection result of the oscillation detection unit 32, whether the position of the projection target 3, which fluctuates due to the oscillation of the projection target 3, is within a predetermined range. Specifically, based on the amplitude of the oscillation of the projection target 3, the projection control unit 33 determines that the position of the projection target 3 is outside the predetermined range if the amplitude is greater than or equal to a predetermined value.

[0062] The projection control unit 33 determines whether the position of the projection target 3 has moved outside a predetermined range based on the result of identifying the position of the projection target 3, which fluctuates due to the oscillation of the projection target 3 (S7).

[0063] If the projection target 3 is outside the predetermined range (S7: Yes), the projection control unit 33 stops projection by the projector 2 (S8). If the projection target 3 is not outside the predetermined range (S7: No), the projection control unit 33 skips the process in S8 and continues projection by the projector 2.

[0064] Next, the projection control unit 33 determines whether or not to terminate the projection of projector 2 in the second projection mode described above (S9). Specifically, if the projection control unit 33 continues to detect people 200 around the projection target 3 and the movement of the projection target 3, it does not terminate the projection of projector 2 in the second projection mode (S9: No) and returns to S5. Therefore, the projection of projector 2 in the second projection mode continues.

[0065] When the detection of oscillation of the projection target 3 ends, the projection control unit 33 determines that projection by projector 2 in the second projection mode should end (S9: Yes), and returns the process to S1. As a result, the projection control unit 33 switches from projection by projector 2 in the second projection mode to projection by projector 2 in the first projection mode.

[0066] Furthermore, the conditions for switching from the second projection mode to the first projection mode are not limited to the completion of detection of oscillation of the projection target 3. For example, the switch from the second projection mode to the first projection mode may occur if projection in the second projection mode continues for a certain period of time.

[0067] As described above, the projection system 100 includes a projection target 3 that is pivotably supported by a suspension member 4, and a projector 2 that projects an image 8 onto the projection target 3. The projection system 100 also includes a camera 6 capable of detecting people 200 around the projection target 3, a vibration sensor 9 capable of detecting the movement of the projection target 3, and an information processing device 1. The information processing device 1 detects people 200 around the projection target 3 based on the detection result of the camera 6, and when it detects the movement of the projection target 3 based on the detection result of the vibration sensor 9, it changes the projection mode of the image 8 in the projector 2.

[0068] Figure 4 is an explanatory diagram showing an example of the projection mode of the projection system 100. As shown on the left side of Figure 4, even if the projection system 100 detects a person 200 around the projection target 3, if it does not detect any movement of the projection target 3, it sets the image 8 on the projector 2 to the first projection mode.

[0069] If person 200 performs an action such as touching the projection target 3 and the projection target 3 is detected to be moving, the projection system 100 sets the image 8 on projector 2 to a second projection mode. Specifically, as shown on the right side of Figure 4, the projection system 100 switches to a second projection mode in which the amount of light from the image light 7 is increased and the projection range is expanded compared to the first projection mode.

[0070] By switching projection modes in this way, the projection system 100 can attract people 200 around the projection target 3 to the image 8, thereby improving the sense of immersion in the visual experience provided by the image 8.

[0071] For example, in the projection system 100, even without any prior explanation, the projection of image 8 towards the swaying projection object 3 can encourage a person 200 to unconsciously touch the projection object 3 or perform other actions.

[0072] Furthermore, the projection system 100 can strongly attract person 200 to the visual experience provided by image 8 by switching the projection mode of image 8. For example, if person 200 is fatigued due to information overload, the projection system 100 is expected to alleviate person 200's fatigue by encouraging them to concentrate on the visual experience.

[0073] Furthermore, the projection system 100 can be used in various locations and scenarios, including not only the aforementioned corridor 110 but also small rooms. Specifically, it could be installed in corridors 110 in hospitals, schools, companies, etc., allowing people to unconsciously immerse themselves in the visual experience while passing through.

[0074] Furthermore, the projection system 100 may be able to alleviate brain fatigue caused by information overload and conditions such as the default mode network by having the effect of focusing the viewer's attention on the visual experience. The default mode network is a mental state in which negative thoughts circulate in the brain due to information overload.

[0075] In the fields of psychology and psychotherapy, mindfulness is often used to address the default mode network state. Mindfulness means "focusing on the present moment, as it is." It is also expected that the visual experience provided by projection system 100 can induce a mindful state.

[0076] Furthermore, the information processing device 1 changes the projection mode of the image 8 when it estimates, based on the detection results from the camera 6 and the vibration sensor 9, that the projection target 3 has swayed due to the movement of the person 200.

[0077] As a result, in the projection system 100, the projection pattern of the image 8 changes when the projection target 3 is shaken by the movement of person 200, that is, when person 200 interferes with the projection target 3, thereby improving the sense of immersion in the visual experience.

[0078] Furthermore, when the information processing device 1 detects oscillation of the projection target 3, it identifies at least one of the amplitude or frequency of the oscillation of the projection target 3, and changes the projection mode of the image 8 based on at least one of the identified amplitude or frequency.

[0079] This allows the projection system 100 to change the projection pattern of the image 8 according to the degree of interference by the person 200 with the projection target 3 when the person 200 touches, enters, or passes through the projection target 3. As a result, the projection system 100 can enhance the sense of immersion in the visual experience.

[0080] Furthermore, when the information processing device 1 detects movement of the projection target 3, it determines whether the projection target 3 is located within a predetermined range, and if the projection target 3 is not located within the predetermined range, it instructs the projector 2 to stop projecting the image 8.

[0081] As a result, the projection system 100 can prevent the unnecessary projection of image 8 in situations where, for example, the projection target 3 is not located within a predetermined range and the image 8 is not projected onto the projection target 3.

[0082] Furthermore, the projection system 100 includes a restricting member 5 that restricts the oscillation of the projection target 3 so that the oscillation direction of the projection target 3 coincides with the optical axis direction of the projector 2.

[0083] As a result, the projection system 100 can prevent the image 8 projected from moving away from the projection target 3, even when the projection target 3 is oscillating.

[0084] The embodiments described above are preferred embodiments of the present invention. However, the invention is not limited to these embodiments, and various modifications can be made without departing from the spirit of the invention.

[0085] For example, the embodiment described above illustrates the use of two projectors 2, a first projector 2A and a second projector 2B, but the number of projectors 2 may be one or three or more.

[0086] Furthermore, the functional units of the control unit 10 shown in Figure 2 represent functional configurations realized through the cooperation of hardware and software, and the specific implementation form is not particularly limited. Therefore, it is not necessarily required that hardware corresponding to each functional unit be implemented individually, and it is certainly possible to have a configuration in which a single processor 30 executes the program 21 to realize the functions of multiple functional units. In addition, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software.

[0087] Furthermore, the program 21 executed by the processor 30 to realize the control method described above may be provided by being recorded on a recording medium readable by the processor 30. The recording medium readable by the processor 30 may be an optical recording medium, a semiconductor memory device, etc. Also, the program 21 may be provided or distributed in the form of a transmission medium, stored on a computer connected to a network such as the Internet, and provided or distributed by downloading it over the network.

[0088] Furthermore, the processing units in the sequence shown in Figure 3 are divided according to their main processing content to facilitate understanding of the processing of the processor 30, and the present invention is not limited by the way the processing units are divided or named as shown in the sequence in Figure 3. In addition, the processing of the processor 30 can be further divided into more processing units depending on the processing content, or it can be divided so that one processing unit contains even more processing. Moreover, the processing order of the above sequence is not limited to the example shown.

[0089] [Summary of this disclosure] A summary of this disclosure is provided below.

[0090] (Note 1) A projection system comprising: a projection target supported so as to be swingable on a support; a projector that projects an image onto the projection target; a first sensor capable of detecting people around the projection target; a second sensor capable of detecting the movement of the projection target; and a computer that, when it detects the person based on the detection result of the first sensor and detects the movement of the projection target based on the detection result of the second sensor, causes the projector to change the projection mode of the image.

[0091] This allows the projection system to draw people around the projected object into the image, thereby enhancing their sense of immersion in the image.

[0092] (Note 2) The projection system according to Appendix 1, wherein the computer, based on the detection results of the first sensor and the second sensor, changes the projection mode of the image when it estimates that the projection target has swayed due to the movement of the person.

[0093] This allows the projection system to improve immersion in the image by allowing the projection target to oscillate in response to the movements of people around it, and by changing the projection pattern when those people interfere with the projection target.

[0094] (Note 3) The projection system according to Appendix 1 or 2, wherein the computer, upon detecting oscillation of the projection target, identifies at least one of the amplitude or frequency of the oscillation of the projection target, and changes the projection mode of the image based on at least one of the identified amplitude or frequency.

[0095] As a result, the projection system can change the projection pattern of the image based on at least one of the amplitude or frequency of the oscillation of the object being projected, thereby improving the sense of immersion in the image.

[0096] (Note 4) The projection system according to any one of the appendices 1 to 3, wherein the computer, upon detecting oscillation of the projection target, determines whether the projection target is located within a first range, and if the projection target is not located within the first range, instructs the projector to stop projecting the image.

[0097] This prevents the projection system from unnecessarily projecting images from the projector when the projection target is not located within the first range, for example, when the image would not be projected onto the projection target.

[0098] (Note 5) A projection system according to any one of appendices 1 to 4, comprising a restricting member for restricting the oscillation of the projection target so that the oscillation direction of the projection target coincides with the optical axis direction of the projector.

[0099] This allows the projection system to prevent the projected image from deviating from the projection target.

[0100] (Note 6) A projection method comprising: a computer detecting a person based on the detection result of a first sensor capable of detecting a person around a projection target that is pivotably supported on a support, and detecting the pivoting of the projection target based on the detection result of a second sensor capable of detecting the pivoting of the projection target, and instructing a projector that projects an image onto the projection target to change the projection mode of the image.

[0101] This allows the projection method to draw people around the projected object into the image, thereby enhancing their sense of immersion in the image.

[0102] (Note 7) A program that causes a computer to detect a person based on the detection result of a first sensor capable of detecting a person around a projection target that is pivotably supported on a support, and to detect the pivoting of the projection target based on the detection result of a second sensor capable of detecting the pivoting of the projection target, and to cause a projector that projects an image onto the projection target to change the projection mode of the image.

[0103] This allows the program to draw people around the projected object into the image, enhancing their sense of immersion in that image. [Explanation of Symbols]

[0104] 1...Information processing device, 2...Projector, 2A...First projector, 2B...Second projector, 3...Projection target, 4...Suspension member, 5...Regulating member, 6...Camera, 7...Image light, 7A...First image light, 7B...Second image light, 8...Image, 8A...First image, 8B...Second image, 9...Vibration sensor, 10...Control unit, 20...Storage unit, 21...Program, 22...Content data, 30...Processor, 31...Human detection unit, 32...Swing detection unit, 33...Projection control unit, 40...Communication unit, 100...Projection system, 110...Passageway, 111...Floor, 112...Ceiling, 113...Wall, 200...Person, D1...Swing direction.

Claims

1. A projection object supported by a support so as to be able to swing, A projector that projects an image onto the aforementioned projection target, A first sensor capable of detecting people around the projection target, A second sensor capable of detecting the oscillation of the projection target, The system includes a computer that detects the person based on the detection result of the first sensor and, when it detects the movement of the projection target based on the detection result of the second sensor, causes the projector to change the projection mode of the image. Projection system.

2. The aforementioned computer, Based on the detection results of the first sensor and the second sensor, if it is estimated that the projection target has swayed due to the movement of the person, the projection mode of the image is changed. The projection system according to claim 1.

3. The aforementioned computer, When oscillation of the projection target is detected, at least one of the amplitude or frequency of the oscillation of the projection target is identified, and the projection mode of the image is changed based on at least one of the identified amplitude or frequency. The projection system according to claim 1.

4. The aforementioned computer, When oscillation of the projection target is detected, it is determined whether the projection target is located within a first range, and if the projection target is not located within the first range, the projector is instructed to stop projecting the image. The projection system according to claim 1.

5. The system includes a restricting member that restricts the oscillation of the projection target so that the oscillation direction of the projection target coincides with the optical axis direction of the projector. The projection system according to claim 1.

6. When a computer detects a person based on the detection result of a first sensor capable of detecting a person around a projection target that is pivotably supported on a support, and detects the pivoting of the projection target based on the detection result of a second sensor capable of detecting the pivoting of the projection target, it instructs a projector that projects an image onto the projection target to change the projection mode of the image. Projection method.

7. The computer is instructed to detect a person based on the detection result of a first sensor capable of detecting a person around a projection target that is pivotably supported on a support, and to instruct a projector that projects an image onto the projection target to change the projection mode of the image when it detects a person based on the detection result of a second sensor capable of detecting the pivoting of the projection target. program.

Images