Projection system control method, projection system, and computer program

Abstract

To provide a projection system control method, a projection system, and a computer program that can provide a sense of presence and the like.SOLUTION: In a control method for a projection system 1000 including a projector 100 that projects content onto a screen 300 and at least one vibration motor 600 that imparts vibration to the screen 300, the at least one vibration motor 600 is controlled on the basis of data representing the content.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a projection system control method, a projection system, and a computer program. [Background technology]

[0002] Patent Document 1 discloses the configuration of a video system that includes a three-dimensional screen formed of a sheet that sways in the wind, a video device that can project content from inside the three-dimensional screen, a blower that causes the three-dimensional screen to sway, and a control device that controls the strength and direction of the wind blown by the blower in synchronization with the image on the video device. In order to give users viewing content a more realistic feeling, it is important to control the blower and the vibration device that vibrates the screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-146579 Summary of the Invention [Problem to be solved by the invention]

[0004] However, although Patent Document 1 describes that the strength and direction of the wind is controlled by a control device, it does not disclose a specific method for controlling the blower or the vibrator. [Means for solving the problem]

[0005] The control method for a projection system includes a projection device that projects content onto a screen and at least one vibration device that imparts vibration to the screen, and controls the at least one vibration device based on data representing the content.

[0006] The projection system includes a projection device that projects content onto a screen, at least one vibration device that imparts vibration to the screen, and a control device that vibrates the at least one vibration device based on data representing the content.

[0007] The computer program causes a computer that controls at least one vibration device that vibrates a screen to perform processing including analyzing data indicating content to be projected onto the screen, determining a vibration mode based on the analyzed data, and transmitting information indicating the determined vibration mode to the at least one vibration device. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of a projection system. [Figure 2] FIG. 2 is a block diagram showing the electrical configuration of the projection system. [Figure 3] 10 is a flowchart showing an example of a control method for the projection system. [Figure 4] FIG. 10 is a schematic diagram showing an example of a control method for the projection system. [Figure 5] 10 is a flowchart showing an example of a control method for the projection system. [Figure 6] FIG. 10 is a schematic diagram showing an example of a control method for the projection system. [Figure 7] 10 is a flowchart showing an example of a control method for the projection system. [Figure 8] FIG. 10 is a schematic diagram showing an example of a control method for the projection system. [Figure 9] FIG. 10 is a schematic diagram showing an example of a control method for a projection system according to a modified example. [Figure 10] FIG. 10 is a schematic diagram showing an example of a control method for a projection system according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0009] The configuration of a projection system 1000 of this embodiment will be described with reference to FIG.

[0010] 1, the projection system 1000 includes a projector 100 as a projection device, a personal computer 200 capable of wirelessly communicating with the projector 100, and a vibration motor 600 as a vibration device that applies vibration to a screen 300. Note that the device is not limited to the personal computer 200, and may be a smartphone or a tablet terminal.

[0011] The projector 100 includes a projection unit 400 for projecting a projection image 500 based on content input from the outside onto a screen 300. The projection unit 400 is, for example, a mercury lamp. There are no particular limitations on the projection unit 400, as long as it functions as a light source for projecting the projection image 500 and the like.

[0012] A projected image 500 is displayed on the screen 300. The projected image 500 may be, for example, a video 510 based on data representing content supplied from the personal computer 200 to the projector 100.

[0013] A plurality of vibration motors 600 that impart vibrations to the screen 300 are attached to the screen 300. Examples of the vibration motors 600 include piezoelectric motors. There are no particular limitations on the type of vibration motor 600 as long as it generates vibrations when driven. The plurality of vibration motors 600 are attached, for example, to the underside of the screen 300 so that they are spaced equally apart from one another. In this embodiment, four vibration motors 600 are arranged on the underside of the screen 300.

[0014] The plurality of vibration motors 600 are driven individually by a driving device 600A. The driving device 600A is capable of wireless communication with the personal computer 200 and the projector 100, for example.

[0015] Next, the electrical configuration of the projection system 1000 will be described with reference to FIG.

[0016] As shown in FIG. 2, the projection system 1000 includes a projector 100 and a personal computer 200.

[0017] The projector 100 has a control unit 110 as a control device, a communication unit 120, an analysis unit 130, a comparison unit 140, a judgment unit 150, a determination unit 160, a memory unit 170, a projection unit 400, and an imaging unit 180 as an imaging device.

[0018] The control unit 110 is configured with one or more processors, and performs overall control of the operation of the projection system 1000 by operating in accordance with a control program that is a computer program stored in the storage unit 170 .

[0019] The communication unit 120 transmits and receives signals to and from the communication unit 210 of the personal computer 200. The communication unit 120 is, for example, a short-range wireless communication such as Bluetooth (registered trademark). Note that the communication is not limited to short-range wireless communication, and communication may be performed via a network such as a LAN (Local Area Network). In other words, the communication may be wireless or wired.

[0020] The analysis unit 130 analyzes data representing content. Specifically, the data is audio data or image data including a first frame played during a first period and a second frame played during a second period following the first period. The analysis unit 130 analyzes, for example, the loudness and frequency of the audio data. The analysis unit 130 also analyzes the speed of image movement and changes in the image in the image data.

[0021] For example, the comparison unit 140 compares the volume of the audio data with a threshold, or compares the high and low frequencies of the audio data with a threshold, or compares the image movement of the image data frame by frame, or compares the image change of the image data frame by frame.

[0022] The determining section 150 determines whether or not to vibrate the vibration motor 600 based on the data obtained by the comparing section 140, for example.

[0023] Based on the analyzed data and the determined data, the determination unit 160 determines the vibration mode in which to vibrate the vibration motor 600. The vibration mode refers to which of the multiple vibration motors 600 to vibrate, the magnitude of the vibration of the vibration motor, the order in which to vibrate the multiple vibration motors 600, etc.

[0024] The storage unit 170 is configured to include memories such as RAM (Random Access Memory) and ROM (Read Only Memory). The RAM is used for temporary storage of various data, and the ROM stores control programs and control data for controlling the operation of the projector 100.

[0025] Although not shown, the projection unit 400 is configured to include a light source, a liquid crystal light valve as a light modulation device, a projection optical system, a light valve driving unit, etc. The projection unit 400 modulates light emitted from the light source with the liquid crystal light valve to form image light, and projects this image light from the projection optical system which includes at least one of a lens and a mirror to display a projection image 500 on the screen 300.

[0026] The imaging unit 180 captures an image of the screen 300 or the projected image 500. The imaging unit 180 may be, for example, a camera equipped with a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor.

[0027] The personal computer 200 includes a communication unit 210 , a control unit 220 , a display unit 230 , and a reading unit 240 .

[0028] As described above, the communication unit 210 transmits and receives signals to and from the communication unit 120 of the projector 100. The communication unit 210 is, for example, a short-range wireless communication unit such as Bluetooth (registered trademark). Note that the communication is not limited to short-range wireless communication, and communication may be performed via a network such as a LAN (Local Area Network).

[0029] The control unit 220 is configured with one or more processors, and controls the overall operation of the personal computer 200 by operating according to a control program.

[0030] The display unit 230 includes a display panel such as an LCD (liquid crystal display), and displays the communication status with the projector 100. The display unit 230 also displays the content to be transmitted to the projector 100 and the analysis status of the data analyzed by the analysis unit 130.

[0031] The reading unit 240 reads data indicating the content via, for example, a playback device that plays back a DVD (Digital Versatile Disk) or the like. The playback device is, for example, built into the personal computer 200. Alternatively, the content data may be imported via the Internet.

[0032] Next, an example of a control method for the projection system 1000 of this embodiment will be described with reference to Figures 3 and 4. In this embodiment, the analysis process performed to vibrate the vibration motor 600 and the control of the drive device 600A that drives the vibration motor 600 are performed by the projector 100. In addition, the following control method executes processing for the first frame, and when this is completed, returns to step S11 and executes processing for the second frame.

[0033] 3, first, in step S11, data indicating content is read. Specifically, the control unit 220 of the personal computer 200 causes the reading unit 240 to read the content data. The display unit 230 displays, for example, the status of the data reading.

[0034] Next, in step S12, the data is transmitted. Specifically, the control unit 220 of the personal computer 200 transmits the read data to the communication unit 120 of the projector 100 via the communication unit 210. The control unit 110 of the projector 100 stores the received data in the storage unit 170.

[0035] Next, in step S13, the data is analyzed. Specifically, control unit 110 reads out the data stored in storage unit 170 and causes analysis unit 130 to analyze the data. Examples of data to be analyzed include the volume of the sound included in the audio data of the first frame, the volume of the sound included in the audio data of the second frame, and the volume of the sound included in the audio data of the third frame, as shown in FIG.

[0036] Next, in step S14, it is determined whether the sound is loud. If the sound is loud (step S14: YES), the process proceeds to step S15. If the sound is not loud (step S14: NO), the process returns to step S11 and performs processing for the second frame.

[0037] Specifically, the control unit 110 causes the comparison unit 140 to compare the volume of the audio data of the first frame with the threshold volume stored in the storage unit 170. The control unit 110 causes the determination unit 150 to determine whether the volume of the audio data of the first frame is greater than the threshold volume. The determination unit 150 may also determine how much the volume of the audio data of the first frame is greater than the threshold volume. In this embodiment, as shown in FIG. 4, the audio data of the second frame is greater than the threshold volume.

[0038] Next, in step S15, the control unit 110 determines the vibration mode of the vibration motor 600. Specifically, the control unit 110 instructs the determination unit 160 to determine the vibration mode of the vibration motor 600 based on the data obtained by the analysis unit 130 and the determination unit 150. For example, if the sound is slightly louder than the threshold, the vibration of the vibration motor 600 is determined to be small. If the sound is significantly louder than the threshold, the vibration of the vibration motor 600 is determined to be large. Note that if the sound is quieter than the threshold, it is determined that the vibration motor 600 will not vibrate.

[0039] Next, in step S16, the vibration motor 600 is vibrated. Specifically, the control unit 110 controls the driving device 600A to vibrate the plurality of vibration motors 600 based on the determined vibration mode, and also causes the projection unit 400 to project the projection image 500 onto the screen 300. In this embodiment, the vibration motor 600 is vibrated only for the second frame. Next, the process returns to step S11, where the analysis of the next frame is performed, and the process is repeated until the content ends.

[0040] In this way, by controlling the projection system 1000, the vibration motor 600 is operated based on data indicating the content, for example, the volume of the sound, so that the screen 300 can be vibrated in a vibration pattern that takes the content into consideration, thereby providing a more realistic feeling to the user viewing the content.

[0041] Next, another example of a control method for the projection system 1000 of this embodiment will be described with reference to Figures 5 and 6. This example differs from the above example in that while the first frame is being played back, the data of the next second frame is analyzed.

[0042] 5, in step S21, data of a first frame of the multiple frames included in the content is read. Specifically, the control unit 220 of the personal computer 200 causes the reading unit 240 to read the data of the first frame. Thereafter, as in the above embodiment, the control unit 220 transmits the data to the communication unit 120 of the projector 100. Thereafter, the control unit 110 causes the storage unit 170 to store the received data.

[0043] In step S22, the data is analyzed. Specifically, the control unit 110 reads out the data stored in the storage unit 170, and causes the analysis unit 130 to analyze the audio data of the first frame. The data may be, for example, the volume of the audio data.

[0044] In step S23, it is determined whether or not to vibrate the vibration motor 600. Specifically, the control unit 110 causes the comparison unit 140 to compare the volume of the sound in the first frame with the threshold volume. Next, the control unit 110 causes the determination unit 150 to determine whether or not the volume of the sound in the first frame is louder than the threshold volume.

[0045] If the sound of the first frame is loud (step S23: YES), it is determined that vibration should be performed, and the process proceeds to step S24. If the sound of the first frame is quiet (step S23: NO), it is determined that vibration should not be performed, and the process proceeds to step S25. Note that, as in the above embodiment, the determination unit 160 may determine the vibration mode of the vibration motor 600.

[0046] In step S24, the first frame is played back and the vibration motor 600 is vibrated. Specifically, the control unit 110 causes the projection unit 400 to project the projection image 500 onto the screen 300. In addition, sound is also played back. The control unit 110 controls the driving device 600A to vibrate the vibration motor 600.

[0047] In step S25, since it was determined in step S23 that vibration should not be performed, only the first frame is played back. Specifically, the control unit 110 causes the projection unit 400 to project the projection image 500 onto the screen 300. In addition, sound is also played back. Vibration by the vibration motor 600 is not performed.

[0048] In step S31, while the first frame is being played back, data of the next second frame is read (see FIG. 6). Specifically, the control unit 220 of the personal computer 200 causes the reading unit 240 to read the data of the second frame. Note that a description of the data transmission method, storage method, etc. will be omitted.

[0049] In step S32, the data of the second frame is analyzed while the first frame is being played back (see FIG. 6). Specifically, the control unit 110 causes the analysis unit 130 to analyze the audio data of the second frame.

[0050] In step S33, it is determined whether or not to vibrate the vibration motor 600 during playback of the first frame. Specifically, the control unit 110 causes the comparison unit 140 to compare the volume of the sound of the second frame with the threshold volume. If the volume of the second frame is loud (step S33: YES), it is determined to vibrate, and the process proceeds to step S34. If the volume of the second frame is quiet (step S33: NO), it is determined not to vibrate, and the process proceeds to step S35.

[0051] In step S34, the second frame is played back and vibration motor 600 is vibrated. Specifically, control unit 110 causes projection unit 400 to project projection image 500 onto screen 300. Control unit 110 also controls drive device 600A to vibrate vibration motor 600.

[0052] In step S35, since it was determined in step S33 that vibration should not be applied, only the second frame is played back. Specifically, the control unit 110 causes the projection unit 400 to project the projection image 500 onto the screen 300. Vibration by the vibration motor 600 is not applied.

[0053] In step S41, while the second frame is being played back, data of the next third frame is read (see FIG. 6). Specifically, the control unit 220 of the personal computer 200 causes the reading unit 240 to read the data of the third frame of the content. Note that a description of the method of transmitting and storing the data will be omitted.

[0054] In step S42, the data of the third frame is analyzed while the second frame is being played back (see FIG. 6). Specifically, the control unit 110 causes the analysis unit 130 to analyze the audio data of the third frame.

[0055] In step S43, it is determined whether or not to vibrate the vibration motor 600 during playback of the second frame. Specifically, the control unit 110 causes the comparison unit 140 to compare the volume of the sound of the third frame with the threshold volume. If the volume of the third frame is loud (step S43: YES), it is determined to vibrate, and the process proceeds to step S44. If the volume of the third frame is quiet (step S43: NO), it is determined not to vibrate, and the process proceeds to step S45.

[0056] In step S44, the third frame is played back and vibration motor 600 is vibrated. Specifically, control unit 110 causes projection unit 400 to project projection image 500 onto screen 300. Control unit 110 also controls drive device 600A to vibrate vibration motor 600.

[0057] In step S45, since it was determined in step S43 that vibration should not be applied, only the third frame is played back. Specifically, the control unit 110 causes the projection unit 400 to project the projection image 500 onto the screen 300. Vibration by the vibration motor 600 is not applied.

[0058] In this way, by controlling the projection system 1000, the second frame is analyzed and the vibration pattern is determined while the first frame is being projected, thereby improving the tracking ability of the second frame, which is projected after the first frame, from the user's perspective.

[0059] Next, another example of a control method for the projection system 1000 of this embodiment will be described with reference to Figures 7 and 8. In this example, the first frame image 510a and the second frame image 510b are compared, and if there is movement, the vibration motor 600 is vibrated, which is different from the above example. Note that a description of frame data reading, communication, etc. will be omitted.

[0060] As shown in FIG. 7, in step S51, it is determined whether or not there has been a change in the first frame. Specifically, the control unit 110 causes the analysis unit 130 to analyze whether or not there has been a change in the video 510a of the first frame. The change may be, for example, the movement of the video 510a or the speed of the video 510a, which are characteristics of the frame. As shown in FIG. 8, the region of the first frame is divided into four regions for analysis: a first region 1A, a second region 2A, a third region 3A, and a fourth region 4A. It is also assumed that there is no video 510 in any frames prior to the first frame.

[0061] Control unit 110 causes comparison unit 140 to compare first region 1A to fourth region 4A of a frame without video 510 with first region 1A to fourth region 4A of the first frame. Next, control unit 110 causes determination unit 150 to determine whether or not there has been a change in first region 1A to fourth region 4A.

[0062] If there is a change in the image 510a of the first frame (step S51: YES), it is determined that vibration should be applied, and the process proceeds to step S52. If there is no change in the image 510a of the first frame (step S51: NO), it is determined that vibration should not be applied, and the process proceeds to step S53. In this embodiment, since the image 510a of a fish or the like appears in the fourth region 4A in the first frame, it is determined that there has been a change in the fourth region 4A.

[0063] In step S52, vibration motor 600 is vibrated. Specifically, control unit 110 causes projection unit 400 to project projection image 500, that is, video image 510a, onto screen 300. Control unit 110 also controls drive device 600A to vibrate vibration motors 600a to 600d.

[0064] In addition, since it is known from the analysis process that there is a change in the fourth region 4A, for example, two vibration motors 600c and 600d that are close to the fourth region 4A may be vibrated. In other words, such a way of vibrating the vibration motor 600 is a vibration mode based on analysis.

[0065] In step S53, it is determined whether or not there has been a change in the second frame. Specifically, control unit 110 causes analysis unit 130 to analyze whether or not there has been a change in image 510b of the second frame.

[0066] Control unit 110 causes comparison unit 140 to compare first region 1A to fourth region 4A of the first frame with first region 1A to fourth region 4A of the second frame. Next, control unit 110 causes determination unit 150 to determine which region of first region 1A to fourth region 4A has changed.

[0067] If there is a change in the second frame (step S53: YES), it is determined that vibration should be performed, and the process proceeds to step S54. If there is no change in the second frame (step S53: NO), it is determined that vibration should not be performed, and the process proceeds to step S55. In this embodiment, since the image 510b of a fish or the like has moved into the first area 1A in the second frame, it is determined that there has been a change in the first area 1A.

[0068] In step S54, vibration motor 600 is vibrated. Specifically, control unit 110 causes projection unit 400 to project projection image 500, i.e., video 510b, onto screen 300. Control unit 110 also controls drive device 600A to vibrate vibration motor 600.

[0069] In addition, since it is known in the analysis process that there is a change in the first region 1A, for example, two vibration motors 600a and 600b that are close to the first region 1A may be vibrated.

[0070] In step S55, it is determined whether or not there has been a change in the third frame. Specifically, control unit 110 causes analysis unit 130 to analyze whether or not there has been a change in image 510c of the third frame.

[0071] Control unit 110 causes comparison unit 140 to compare first region 1A to fourth region 4A of the second frame with first region 1A to fourth region 4A of the third frame. Next, control unit 110 causes determination unit 150 to determine which region of first region 1A to fourth region 4A has changed.

[0072] If there is a change in the third frame (step S55: YES), it is determined that vibration should be applied, and the process proceeds to step S56. If there is no change in the third frame (step S55: NO), it is determined that vibration should not be applied, and the process ends. It is preferable to continue processing the fourth and fifth frames. In this embodiment, it may be determined that there has been a change in the first region 1A in the third frame because the image 510c of a fish or the like has disappeared from the first region 1A, or it may be determined that there has been no change because the fish is no longer there.

[0073] In step S56, the control unit 110 vibrates the vibration motor 600. Specifically, the control unit 110 causes the projection unit 400 to project the projection image 500, that is, the video 510c, onto the screen 300. The control unit 110 also controls the driving device 600A to vibrate the vibration motor 600.

[0074] In addition, since it is known in the analysis process that there is a change in the first region 1A, for example, two vibration motors 600a and 600b that are close to the first region 1A may be vibrated.

[0075] In this way, the projection system 1000 is controlled, and the vibration motor 600 is controlled based on changes in the characteristics of the data of the first frame and the characteristics of the data of the second frame, so that a more realistic feeling can be given to the user.

[0076] As described above, the control method for projection system 1000 of this embodiment is a control method for projection system 1000 including projector 100 that projects content onto screen 300 and at least one vibration motor 600 that imparts vibration to screen 300, and controls at least one vibration motor 600 based on data that represents the content. According to this method, vibration motor 600 is operated based on data that represents the content, such as sound or changes between frames, so it is possible to vibrate screen 300 in a vibration mode that takes the content into consideration, thereby providing a more realistic feeling to a user viewing the content.

[0077] Furthermore, in the control method for the projection system 1000 of this embodiment, it is preferable that the data includes audio data of the content, and that the operation of at least one vibration motor 600 is controlled based on the audio data. According to this method, the vibration motor 600 is operated based on the audio data, which is an important parameter in considering the sense of realism, thereby further improving the sense of realism.

[0078] Furthermore, in the control method for projection system 1000 of this embodiment, the data preferably includes a first frame played during a first period and a second frame played during a second period after the first period, and control unit 110 preferably includes the steps of reading the first frame of the first and second frames, analyzing the first frame before projecting the first frame by projector 100 and applying vibrations by at least one vibration motor 600, determining a vibration mode based on the results of analyzing the first frame, and playing the content and applying vibrations after determining the vibration mode. According to this method, the first frame is analyzed in advance before projecting the first frame by projector 100 and applying vibrations by at least one vibration motor 600. This makes it possible to change the vibration mode in real time in conjunction with the content as seen by the user, thereby providing a more realistic feeling.

[0079] Furthermore, the control method for projection system 1000 of this embodiment preferably includes analyzing the second frame while the first frame is being projected, determining a vibration mode based on the results of analyzing the second frame, and playing back the second frame and applying vibration after determining the vibration mode. According to this method, the second frame is analyzed and the vibration mode is determined while the first frame is being projected, thereby improving the tracking ability of the second frame, which is projected after the first frame, as seen from the user.

[0080] In addition, in the control method for the projection system 1000 of this embodiment, it is preferable that the data includes a first frame played in a first period and a second frame played in a second period after the first period, and at least one vibration motor 600 is controlled based on the change between the first frame and the second frame. According to this method, the vibration motor 600 is controlled based on the change between the characteristics of the data of the first frame and the characteristics of the data of the second frame, thereby providing the user with an even more realistic feeling.

[0081] Furthermore, the projection system 1000 of this embodiment includes a projector 100 that projects content onto a screen 300, at least one vibration motor 600 that imparts vibrations to the screen 300, and a control unit 110 that vibrates the at least one vibration motor 600 based on data that represents the content. With this configuration, the vibration motor 600 is operated based on data that represents the content, such as sound or changes between frames, so it is possible to vibrate the screen 300 in a vibration mode that takes the content into consideration, thereby providing a more realistic feeling to the user viewing the content.

[0082] Furthermore, the computer program of this embodiment causes the control unit 110, which is a computer that controls at least one vibration motor 600 that vibrates the screen 300, to execute processes including analyzing data that indicates content to be projected onto the screen 300, determining a vibration mode based on the analyzed data, and transmitting information that indicates the determined vibration mode to the at least one vibration motor 600. According to this program, the vibration mode is determined based on data that indicates the content, such as sound or changes between frames, and therefore it is possible to provide a computer program that can vibrate the screen 300 in a vibration mode that takes the content into consideration.

[0083] Modifications of the above-described embodiment will now be described.

[0084] As described above, the present invention is not limited to projecting a projection image 500 of data based on the content onto the screen 300. For example, as shown in FIG. 9, a projection image 520 that prompts the user to determine the optimum positioning area for the vibration motor 600 may be projected onto the screen 300 before the content is played.

[0085] An arrow indicating the range in which the vibration motor 600 is to be placed is displayed on the projection image 520, and this range is the range in which the projection image 500 is projected. The user installs multiple vibration motors 600 within the range indicated by the arrow on the projected projection image 520. In this way, the projection image 520 is projected to specify the position in which at least one vibration motor 600, which is an important element for improving the sense of realism, so the user can easily install at least one vibration motor 600.

[0086] As described above, in the control method for the projection system 1000 of the modified example, the projector 100 preferably projects the projection image 520 that specifies the position where at least one vibration motor 600 is to be attached on the screen 300. According to this method, the projector 100 projects the projection image 520 that specifies the position where at least one vibration motor 600, which is an important element for improving the sense of realism, so that the user can easily install the at least one vibration motor 600.

[0087] Furthermore, in the control method for the projection system 1000 of the modified example, it is preferable that the projector 100 projects the projection image 520 that specifies the positional relationship between the projection image 500 and the at least one vibration motor 600. According to this method, the projector 100 projects the projection image 520 that specifies the positional relationship between the projection image 500 and the at least one vibration motor 600, which is an important element for improving the sense of realism, so that the user can easily grasp the position of the at least one vibration motor 600 relative to the projection image 520.

[0088] Furthermore, as described above, it is not limited to placing the vibration motor 600 in the range where the projection image 500 is projected, but as shown in Figure 10, multiple vibration motors 600 may be placed in advance, and only the vibration motors 600 in the range where the projection image 500 is projected may be vibrated.

[0089] 10, a plurality of vibration motors 600 are arranged in advance on the screen 300 at approximate positions where the image will be projected. It is preferable to attach a reflector or the like to the vibration motors 600 so that the imaging unit 180 can easily identify them. For example, a total of eight vibration motors 600 are arranged, namely, vibration motors 600a, 600b, 600c, 600d, 600e, 600f, 600g, and 600h from left to right. Thereafter, the projection image 500 is projected, and the imaging unit 180 provided in the projector 100 captures an image of the entire area where the eight vibration motors 600 are arranged.

[0090] Based on the captured image data, the vibration motors 600 that overlap the projection image 500 in the vertical direction are identified. For example, the identification method is performed by the analysis unit 130. In this modification, since the projection image 500 overlaps with four vibration motors 600c, 600d, 600e, and 600f, for example, only the four vibration motors 600c, 600d, 600e, and 600f may be used. Note that the remaining four vibration motors 600a, 600b, 600g, and 600h may not be used.

[0091] As described above, the control method for the projection system 1000 of the modified example preferably includes an imaging unit 180 that captures an image of the screen 300 onto which content is projected, and determines the number of at least one vibration motor 600 based on the range of the content captured by the imaging unit 180. According to this method, the number of vibration motors 600 to be used is determined based on the range of the content, making it possible to prevent vibrations in areas distant from the content.

[0092] Furthermore, as described above, the method is not limited to using the imaging unit 180 to limit the vibration motor 600 that vibrates in accordance with the position of the projected image 500. Instead, the projected image 510 may be captured by the imaging unit 180, and if an object included in the image 510 moves or moves at high speed, the part of the screen 300 corresponding to that part may be vibrated by the vibration motor 600.

[0093] Furthermore, as described above, the arrangement is not limited to multiple vibration motors 600 arranged below the screen 300, and for example, a single long vibration motor 600 may be arranged along the bottom side of the screen 300. Furthermore, the vibration motor 600 is not limited to being arranged only below the screen 300, and may be arranged so as to surround the screen 300, or multiple vibration motors 600 may be arranged in a matrix across the entire back surface of the screen 300. Furthermore, instead of vibrating the entire screen 300, selective vibration may be provided to portions of the screen 300.

[0094] Furthermore, as described above, the control unit 110 built into the projector 100 controls the analysis unit 130 and the driving device 600A, but this is not limiting, and the analysis unit may be provided in the personal computer 200 and controlled by the control unit 220 of the personal computer 200. Furthermore, an independent device other than the projector 100 or the personal computer 200 may have a control unit or an analysis unit and perform control.

[0095] The following is a summary of this disclosure. (Supplementary Note 1) A control method for a projection system including a projection device that projects content onto a screen and at least one vibration device that imparts vibration to the screen, the control method executing control of the at least one vibration device based on data representing the content. According to this method, the vibration device is operated based on data representing the content, such as sound or inter-frame changes, so that it is possible to vibrate the screen in a vibration mode that takes the content into consideration, and to give a more realistic feeling to users viewing the content.

[0096] (Supplementary Note 2) A control method for a projection system according to Supplementary Note 1, wherein the data includes audio data of the content, and the operation of the at least one vibration device is controlled based on the audio data. This method operates the vibration device based on the audio data, which is an important parameter in considering the sense of realism, thereby further improving the sense of realism.

[0097] (Supplementary Note 3) A control method for a projection system according to Supplementary Note 1 or Supplementary Note 2, wherein the data includes a first frame played during a first period and a second frame played during a second period after the first period, and a control device includes: reading the first frame of the first and second frames; analyzing the first frame before the projection device projects the first frame and the at least one vibration device applies vibration; determining a vibration mode based on the analysis of the first frame; and playing the content and applying the vibration after determining the vibration mode. According to this method, the first frame is analyzed in advance before the projection device projects the first frame and the at least one vibration device applies vibration, so that the vibration mode can be changed in real time in conjunction with the content as seen by the user, thereby providing a more realistic experience.

[0098] (Supplementary Note 4) A control method for a projection system according to Supplementary Note 3, comprising: analyzing the second frame while the first frame is being projected; determining the vibration mode based on the results of analyzing the second frame; and, after determining the vibration mode, playing the second frame and applying the vibration. According to this method, the second frame is analyzed and the vibration mode is determined while the first frame is being projected, thereby improving the tracking ability of the second frame, which is projected after the first frame, as seen from the user.

[0099] (Supplementary Note 5) A control method for a projection system according to any one of Supplementary Notes 1 to 4, wherein the data includes a first frame played in a first period and a second frame played in a second period after the first period, and the at least one vibration device is controlled based on a change between the first frame and the second frame. This method controls the vibration device based on changes in the characteristics of the data of the first frame and the characteristics of the data of the second frame, thereby providing the user with an even more realistic feeling.

[0100] (Supplementary Note 6) A control method for a projection system according to any one of Supplementary Notes 1 to 5, wherein the projection device projects an image specifying a position for attaching the at least one vibration device onto the screen. According to this method, the projection device projects an image specifying a position for attaching the at least one vibration device, which is an important element for improving the sense of realism, so that the user can easily install the at least one vibration device.

[0101] (Supplementary Note 7) A control method for a projection system according to any one of Supplementary Notes 1 to 5, wherein the projection device projects an image that specifies the positional relationship between the projection image and the at least one vibration device. According to this method, the projection device projects an image that specifies the positional relationship between the projection image and the at least one vibration device, which is an important element for improving the sense of realism, so that the user can easily grasp the position of the at least one vibration device relative to the projection image.

[0102] (Supplementary Note 8) A control method for a projection system according to any one of Supplementary Notes 1 to 7, comprising an imaging device that captures an image of the screen onto which the content is projected, and determining the number of the at least one vibration device based on the range of the content captured by the imaging device. According to this method, the number of vibration devices to be used is determined based on the range of the content, thereby making it possible to suppress vibrations in places far from the content.

[0103] (Supplementary Note 9) A projection system comprising: a projection device that projects content onto a screen, at least one vibration device that imparts vibration to the screen, and a control device that vibrates the at least one vibration device based on data representing the content. With this configuration, the vibration device is operated based on data representing the content, such as sound or inter-frame changes, so it is possible to vibrate the screen in a vibration mode that takes the content into consideration, thereby providing a more realistic feeling to users viewing the content.

[0104] (Supplementary Note 10) A computer program that causes a computer that controls at least one vibration device that vibrates a screen to execute a process that includes analyzing data that indicates content to be projected onto the screen, determining a vibration mode based on the analyzed data, and transmitting information that indicates the determined vibration mode to the at least one vibration device. This program determines the vibration mode based on data that indicates the content, such as sound or changes between frames, and therefore can provide a computer program that can vibrate the screen in a vibration mode that takes the content into consideration. [Explanation of symbols]

[0105] 100...projector as projection device, 110...control unit, 120...communication unit, 130...analysis unit, 140...comparison unit, 150...judgment unit, 160...decision unit, 170...memory unit, 180...imaging unit, 200...personal computer, 210...communication unit, 220...control unit, 230...display unit, 240...reading unit, 300...screen, 400...projection unit, 500...projected image, 510...video, 510a...video, 510b...video, 510c...video, 520...projected image, 600...vibration motor as vibration device, 600A...drive unit, 1000...projection system.

Claims

1. a projection device that projects content onto a screen; at least one vibration device that imparts vibration to the screen; A method for controlling a projection system, comprising: A method for controlling a projection system, comprising controlling the at least one vibration device based on data representing the content.

2. 2. A method for controlling a projection system according to claim 1, comprising: the data includes audio data of the content, A method for controlling a projection system, comprising controlling operation of the at least one vibration device based on the audio data.

3. 2. A method for controlling a projection system according to claim 1, comprising: the data includes a first frame to be played in a first period and a second frame to be played in a second period after the first period; The control device reading the first frame out of the first frame and the second frame; analyzing the first frame before the projection device projects the first frame and the at least one vibration device applies vibration to the first frame; determining a vibration mode based on a result of analyzing the first frame; After determining the vibration mode, playing the content and applying the vibration; A method for controlling a projection system, comprising:

4. 4. A method for controlling a projection system according to claim 3, comprising: analyzing the second frame while the first frame is being projected; determining the vibration mode based on a result of analyzing the second frame; and After determining the vibration mode, playing the second frame and applying the vibration; A method for controlling a projection system, comprising:

5. 2. A method for controlling a projection system according to claim 1, comprising: the data includes a first frame to be played in a first period and a second frame to be played in a second period after the first period; A method for controlling a projection system, comprising controlling the at least one vibration device based on a change between the first frame and the second frame.

6. 2. A method for controlling a projection system according to claim 1, comprising: A method for controlling a projection system, wherein the projection device projects an image on the screen that specifies a position where the at least one vibration device is to be attached.

7. 2. A method for controlling a projection system according to claim 1, comprising: A control method for a projection system, wherein the projection device projects an image that specifies a positional relationship between the projection image and the at least one vibration device.

8. 2. A method for controlling a projection system according to claim 1, comprising: an imaging device that captures an image of the screen onto which the content is projected; A method for controlling a projection system, comprising determining the number of the at least one vibration device based on a range of the content captured by the imaging device.

9. a projection device that projects content onto a screen; at least one vibration device that imparts vibration to the screen; a control device that vibrates the at least one vibration device based on data representing the content; A projection system comprising:

10. a computer that controls at least one vibration device that vibrates the screen; analyzing data indicative of content to be projected onto the screen; determining a vibration mode based on the analyzed data; transmitting information indicative of the determined vibration mode to the at least one vibration device; A computer program that causes a process to be performed, including:

Images