Projection device, projection system, and program

Abstract

The present invention provides a projection device, projection system, and program that provide a comfortable sound environment for users viewing images projected onto a projection surface, regardless of the installation conditions of the projection device. [Solution] The projection device 10 includes a distance sensor 140 that measures the distance to multiple positions on the screen 30 and outputs a measured value indicating the distance to the measured multiple positions, multiple speakers 175, a processor 195, and a projector 300 that projects an image onto the screen. The processor 195 calculates the tilt of the projector 300 relative to the screen 30 based on the measured value output by the distance sensor 140, and controls the output of the multiple speakers 175 based on the tilt.

Description

Technical Field

[0001] The present invention relates to a projection device, a projection system, and a program.

Background Art

[0002] Conventionally, a technique for changing the left-right balance of speakers provided in a projector based on the positional relationship between a projection surface and the projection device has been known.

[0003] For example, the projector disclosed in Patent Document 1 includes lens parameter acquisition means for acquiring positional relationship parameters related to the positional relationship between the installation position of the projector and the formation position of the projection image on the projection surface. This lens parameter acquisition means acquires, as positional relationship parameters, the movement amount of the zoom lens, the movement amount of the focus lens, and the lens shift amount, based on a manual operation performed by the user. The projector corrects an audio signal based on the acquired positional relationship parameters and outputs the corrected audio signal to a plurality of speakers.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the projector disclosed in Patent Document 1, it is necessary for the user to move the zoom lens and the focus lens manually and determine parameters for geometric correction, lens shift, and focus correction. For this reason, when the user cannot input accurate parameters manually, there is a problem that the balance of the volumes of the left and right speakers is felt to be poor.

Means for Solving the Problems

[0006] The projection device of the present disclosure comprises a distance sensor that measures the distance to a plurality of positions on the projection surface and outputs a measured value indicating the distance to the plurality of positions, a plurality of speakers, one or more processors, and a projector that projects an image onto the projection surface, wherein the one or more processors perform the following actions: calculate the tilt of the projector with respect to the projection surface based on the measured value output by the distance sensor, and control the output of the plurality of speakers based on the tilt.

[0007] The projection system of the present disclosure comprises a plurality of speakers, a projection device, the projection device comprising a distance sensor that measures the distance to a plurality of positions on the projection surface and outputs a measured value indicating the distance to the plurality of positions, one or more processors, and a projector that projects an image onto the projection surface, the one or more processors performing the following: calculating the tilt of the projector with respect to the projection surface based on the measured value output by the distance sensor, and controlling the output of the plurality of speakers based on the tilt.

[0008] The program of this disclosure is a program to be executed by a processor mounted on an information processing device, which causes the processor to perform the following actions: calculate the inclination of a projection device that projects an image onto the projection surface with respect to the projection surface, based on the distances to a plurality of positions on the projection surface measured by a distance sensor; and control the output of a plurality of speakers based on the calculated inclination. [Brief explanation of the drawing]

[0009] [Figure 1] A block diagram showing the configuration of the projection device. [Figure 2] A perspective view showing the external appearance of the projection device. [Figure 3] A diagram showing the configuration of a projector. [Figure 4] A diagram showing the angle between the screen and the projection device. [Figure 5] A diagram showing an example of the placement of a projection device relative to a screen. [Figure 6] A diagram showing an example where the projection device is placed near a wall in a room. [Figure 7] A flowchart illustrating the operation of the projection device. [Modes for carrying out the invention]

[0010] [1. Projection device configuration] Figure 1 is a block diagram showing the configuration of the projection device 10, and Figure 2 is a perspective view showing the external appearance of the projection device. The configuration of the projection device 10 will be described with reference to Figures 1 and 2. The projection device 10 comprises a main body 100 and a base 200. The main unit 100 is equipped with a functional unit that realizes the functions of the projection device 10. The functional unit includes the communication interface 110, image processing unit 120, frame memory 125, remote control light receiver 130, distance sensor 140, drive unit 150, imaging unit 160, projector 300, audio processing unit 170, speaker 175, and control unit 180 shown in Figure 1. Hereinafter, the interface will be abbreviated as I / F.

[0011] The main body 100 is supported on the base 200 by support members 210A and 210B shown in Figure 2. The base 200 is driven by a drive unit 150 provided in the main body 100 and is configured to rotate 360 ​​degrees horizontally to the mounting surface on which the projection device 10 is installed, either counterclockwise or clockwise. Counterclockwise or clockwise rotation in the horizontal direction corresponds to rotation in a predetermined direction.

[0012] Next, we will explain the functional parts of the main body 100 of the projection device 10. The projection device 10 is a device that generates image light based on image data and projects the generated image light onto a screen 30, which is the projection surface. This image data may be data transmitted from an information processing device such as a personal computer connected via the network 20, or it may be data stored in advance in the storage unit 191 of the projection device 10. In this embodiment, the case where the projection surface is a screen 30 is described, but the projection surface may be a wall surface of a room.

[0013] The communication interface 110 includes, for example, a communication card such as a NIC (Network Interface Card), and communicates data with an information processing device (not shown) via the network 20. Figure 1 shows an example where the communication interface 110 is connected to the network 20 via a wired connection, but the connection between the projection device 10 and the network 20 may be a wireless connection such as Wi-Fi. Wi-Fi is a registered trademark.

[0014] The image processing unit 120 receives image data received from the information processing device via the communication interface 110. A frame memory 125 is connected to the image processing unit 120. The frame memory 125 has multiple banks. Each bank has a storage capacity capable of writing image data for one frame. The frame memory 125 is composed of, for example, SDRAM (Synchronous Dynamic Random Access Memory). The image processing unit 120 expands the image data input from the communication interface 110 into the frame memory 125.

[0015] The image processing unit 120 performs image processing on the image data developed in the frame memory 125. The image processing performed by the image processing unit 120 includes, for example, resolution conversion processing or resizing processing, correction of distortion aberration, shape correction processing, digital zoom processing, adjustment of the color tone and brightness of the image, etc. The image processing unit 120 executes the processing specified by the control unit 180 and performs the processing using the parameters input from the control unit 180 as necessary. Also, the image processing unit 120 can of course execute a combination of a plurality of the above image processes. The image processing unit 120 reads out the image data developed in the bank selected by the control unit 180 from the frame memory 125 and outputs the read image data to the projector 300.

[0016] The image processing unit 120 and the frame memory 125 are, for example, constituted by an integrated circuit. The integrated circuit includes LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field-Programmable Gate Array), SoC (System-on-a-chip), etc. Also, an analog circuit may be included in a part of the configuration of the integrated circuit, or a configuration in which the control unit 180 and the integrated circuit are combined may be adopted.

[0017] FIG. 3 is a diagram showing an example of the configuration of the projector 300. Here, the configuration of the projector 300 will be described while referring to FIG. 3. The projector 300 modulates the light emitted from the light source 310 to generate image light, and enlarges and projects the generated image light by the optical unit 350. The projector 300 includes a light source 310, three liquid crystal panels 330R, 330G, and 330B as a light modulation device, an optical unit 350, and a panel drive unit 370. Hereinafter, when collectively referring to the liquid crystal panels 330R, 330G, and 330B included in the projector 300, they are denoted as the liquid crystal panel 330.

[0018] The light source 310 includes a discharge-type light source lamp such as an ultra-high pressure mercury lamp or a metal halide lamp, or a solid light source such as a light-emitting diode or a semiconductor laser. The light emitted from the light source 310 is incident on the liquid crystal panel 330. The liquid crystal panels 330R, 330G, and 330B are each constituted by a transmissive liquid crystal panel or the like in which liquid crystal is enclosed between a pair of transparent substrates. The liquid crystal panel 330R modulates red light, the liquid crystal panel 330G modulates green light, and the liquid crystal panel 330B modulates blue light. Each liquid crystal panel has a pixel region formed of a plurality of pixels arranged in a matrix, and a drive voltage can be applied to the liquid crystal for each pixel.

[0019] The panel drive unit 370 receives the image data output from the image processing unit 120. The panel drive unit 370 applies a drive voltage corresponding to the input image data to each pixel in the pixel region and sets each pixel to a light transmittance corresponding to the image data. The light emitted from the light source 310 is modulated for each pixel by passing through the pixel regions of the liquid crystal panels 330R, 330G, and 330B, and image light corresponding to the image data is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to become image light representing a color image. The optical unit 350 includes a projection lens or the like and enlarges and projects the image light modulated by the liquid crystal panels 330R, 330G, and 330B onto the screen 30.

[0020] Returning to FIG. 1, the configuration of the projection apparatus 10 will be continued to be described. The remote control light receiving unit 130 receives an infrared signal transmitted from the remote control 135. The remote control 135 includes a plurality of buttons such as a power button, a source switching button, a volume button, and an image projection end button, and transmits an infrared signal corresponding to the button operated by the user to the projection apparatus 10. The remote control light receiving unit 130 outputs an operation signal corresponding to the received infrared signal to the control unit 180. The operation signal is a signal corresponding to the button of the remote control 135 operated by the user.

[0021] The distance sensor 140 is a sensor that measures the distance to an object. The object includes, for example, the projection surface screen 30, and objects such as walls and other objects placed around the screen 30. This embodiment describes a case where the distance sensor 140 is configured as a ToF (Time of Flight) sensor, but the distance sensor 140 is not limited to a ToF sensor. For example, it may be a LiDAR (Light Detection and Ranging) sensor, an ultrasonic sensor, or a system that measures distance using a stereo camera. Furthermore, while it is preferable for the distance sensor 140 to be positioned close to the projection lens, it is not particularly limited.

[0022] The drive unit 150 is equipped with a drive device such as a motor and is connected to a drive force transmission member such as a gear provided on the base unit 200. By rotating the motor of the drive unit 150 under the control of the control unit 180, the base unit 200 rotates horizontally to the left or horizontally to the right.

[0023] The imaging unit 160 corresponds to a detection sensor. The imaging unit 160 includes a lens and an image sensor. The lens and image sensor are not shown in the illustration. The lens causes incident light from the imaging range to form an image on the image sensor. The image sensor consists of a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), etc., and generates an image. The imaging unit 160 outputs the generated image to the control unit 180.

[0024] The audio processing unit 170 is composed of, for example, a processor for audio processing. The left speaker 175A and the right speaker 175B are connected to the audio processing unit 170. The left speaker 175A and the right speaker 175B are positioned at both ends of the main unit 100 in the width direction, respectively. The left speaker 175A is positioned to the left of the projection device 10 when viewed from the rear, and the right speaker 175B is positioned to the right of the projection device 10 when viewed from the rear. Hereinafter, the left speaker 175A and the right speaker 175B will be collectively referred to as speaker 175. The audio processing unit 170 performs D / A conversion on the audio data input from the control unit 180 to convert it into an analog audio signal. The audio processing unit 170 then amplifies the converted audio signal and outputs the amplified audio signal as sound from the speaker 175.

[0025] The control unit 180 is a computer device comprising a storage unit 191 and a processor 195. In this embodiment, the projection device 10 corresponds to an information processing device. Therefore, the processor 195 corresponds to a processor mounted on the information processing device.

[0026] The memory unit 191 includes RAM (Random Access Memory) and ROM (Read Only Memory). The RAM is used for temporary storage of various data. For example, the RAM stores distance measurements taken by the distance sensor 140. The ROM stores the control program 193 that controls the operation of the processor 195, as well as various setting data. The various setting data includes a dataset measured in advance when the projection device 10 is installed parallel to the screen 30, as will be described later.

[0027] The processor 195 is an arithmetic processing unit equipped with a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The processor 195 may consist of a single processor or multiple processors. Furthermore, the processor 195 may consist of part or all of the memory unit 191, or an SoC integrated with other circuits. Alternatively, the processor 195 may consist of a combination of a CPU that executes programs and a DSP (Digital Signal Processor) that performs predetermined arithmetic processing. In addition, the processor 195 may be configured with all its functions implemented in hardware, or it may be configured using a programmable device. Note that the various control functions realized by the processor 195 executing the control program 193 stored in the memory unit 191 may sometimes be simply described as the operation of the control unit 180 or the operation of the processor 195.

[0028] The control unit 180 acquires the measurement values ​​measured by the distance sensor 140 from the storage unit 191 and calculates the tilt of the projection device 10 relative to the screen 30 based on the acquired measurement values. The inclination of the projection device 10 relative to the screen 30 is the inclination of the housing that constitutes the main body 100 of the projection device 10 relative to the screen 30. Furthermore, the inclination of the projection device 10 with respect to the screen 30 can also be expressed as the inclination of the projector 300 with respect to the screen 30. Specifically, the inclination of the projector 300 with respect to the screen 30 is the inclination of the projector 300 with respect to the screen 30 in a horizontal plane perpendicular to the optical axis of the projection lens of the projector 300, when the projector 300 is fixed to the projection device 10. The distance sensor 140 measures distances at multiple points on the screen 30 and outputs the measured values ​​to the control unit 180.

[0029] Figure 4 shows the angle α between the screen 30 and the projection device 10. Figure 4 shows the case where the angle α between the projection device 10 and the screen 30 is angle α1 and angle α2. Here, angle α is the inclination angle of the optical axis of the projection lens with respect to the normal of the screen 30. Furthermore, Figure 4 shows a provisional screen 30V with a dashed line. The provisional screen 30V represents a screen 30 installed parallel to the projection device 10. The provisional screen 30V includes a provisional screen 301V corresponding to angle α1 and a provisional screen 302V corresponding to angle α2. Furthermore, Figure 4 shows the optical axis direction OA of the projection lens as a dashed line. The optical axis direction OA of the projection lens includes OA1, which corresponds to angle α1, and OA2, which corresponds to angle α2.

[0030] The control unit 180 determines the angle α between the screen 30 and the projection device 10. Angle α1 coincides with the angle between the normal vector OB of the screen 30 and the optical axis direction OA1 of the projection lens of the projection device 10, where the angle α between the projection device 10 and the screen 30 is angle α1. The normal vector OB of the screen 30 is shown as a dashed line. Angle α2 also coincides with the angle between the normal vector OB of the screen 30 and the optical axis direction OA2 of the projection lens of the projection device 10, where the angle α between the projection device 10 and the screen 30 is angle α2.

[0031] Point s in Figure 4 indicates the point where the optical axis of the projection lens of the projection device 10 intersects the screen 30. Point t1' in Figure 4 indicates the point where, in the horizontal direction, a line segment with an angle β between the optical axis of the projection lens of the projection device 10 and the screen 30, where the angle α with the screen 30 is angle α1, intersects the screen 30. Point t1 in Figure 4 indicates the point where this line segment intersects a hypothetical screen 301V. Point t2' in Figure 4 indicates the point where, in the horizontal direction, a line segment with an angle β between the optical axis of the projection lens of the projection device 10 and the screen 30, where the angle α with the screen 30 is angle α2, intersects the screen 30. Point t2 in Figure 4 indicates the point where this line segment intersects a hypothetical screen 302V.

[0032] The configuration data includes a set of datasets measured in advance when the projection device 10 is installed so that it is parallel to the screen 30, and a conversion table in which angles corresponding to the ratio described later are registered. The first data set represents the distance between the projection device 10 and the screen 30 in the optical axis direction. In other words, it represents the distance OA1 shown in Figure 4. This data was measured while changing the distance between the projection device 10 and the screen 30, while maintaining the projection device 10 parallel to the screen 30. This data is referred to as the first data set. The second set of data in the dataset represents the distance between the projection device 10 and the screen 30 in the direction of a predetermined angle β with respect to the optical axis. In other words, it is data obtained by measuring the distance from the projection device 10 to point t1, as shown in Figure 4, while changing the distance between the projection device 10 and the screen 30. This data is called the second set of data. The conversion table is a conversion table in which the ratio of the angle between the second data and the optical axis to the measurement data in the direction of a preset angle β corresponds to the angle α between the screen 30 and the projection device 10.

[0033] Here is an example of how to create a conversion table. First, we show the relationship between the angle α between the screen 30 and the projection device 10 and the angle with the optical axis, which is obtained by dividing the distance from the projection device 10 to the screen 30 in the direction of a predetermined angle β by the distance from the projection device 10 to a temporary screen 30V. In Figure 4, O1 is the position where the distance sensor 140 of the projection device 10 is installed when the angle α it makes with the screen 30 is angle α1, and O2 is the position where the distance sensor 140 of the projection device 10 is installed when the angle α it makes with the screen 30 is angle α2. In Figure 4, assume that angle α1 is smaller than angle α2. At this time, in the direction of a predetermined angle β with respect to the optical axis, the distance O1t1' from the projection device 10 to the screen 30, where the angle α with the screen 30 is angle α1, is divided by the distance O1t1 from the projection device 10 to the temporary screen 301V, where the angle α with the screen 30 is angle α1. In other words, a value representing the ratio of these two distances, O1t1' / O1t1, is calculated. From Figure 4, the value representing the ratio of distances O1t1' / O1t1 calculated from the projection device 10 where the angle α with the screen 30 is angle α1 is smaller than the value representing the ratio of distances O2t2' / O2t2 calculated from the projection device 10 where the angle α with the screen 30 is angle α2. In other words, it can be seen that the larger the angle between the screen 30 and the projection device 10, the larger the value representing the ratio of distances. By utilizing the above properties, a conversion table can be created in which the values ​​representing the ratio of distances are associated with angles, by calculating values ​​representing the ratio of distances while changing the angle between the screen 30 and the projection device 10 in advance. When creating the conversion table, in addition to saving the values ​​representing the ratio of distances and angles in association, nonlinear interpolation may be performed to calculate the values ​​representing the ratio of distances corresponding to angles that have not been measured.

[0034] The control unit 180 acquires measurement data from the distance sensor 140 regarding the optical axis direction of the projection lens of the projection device 10. Next, the control unit 180 acquires data from the distance sensor 140 indicating the distance between the projection device 10 and the screen 30 in the direction of a preset angle β, where the angle between the projection lens of the projection device 10 and the optical axis is. Next, the control unit 180 detects first data from the setting data that corresponds to the measurement data regarding the optical axis direction of the projection lens of the projection device 10. Next, the control unit 180 acquires second data that is registered in association with the first data. Next, the control unit 180 calculates the angle α between the screen 30 and the projection device 10 based on the ratio of the second data acquired from the setting data and the measurement data where the angle between the projection lens of the projection device 10 and the optical axis is in the direction of a preset angle β, and a conversion table. If the angle associated with the calculated ratio is not found in the conversion table, the control unit sets the angle associated with the ratio in the conversion table that is closest to the calculated ratio as angle α.

[0035] Figure 5 shows an example of the arrangement of the projection device 10 relative to the screen 30. A projection device 10 installed parallel to the screen 30 will be referred to as projection device 10A. A projection device 10 installed to the left of the screen 30 in the drawing will be referred to as projection device 10B. In Figure 5, projection device 10B is installed at an angle to the screen 30 such that, in the drawing, the right end of projection device 10B is further away from the screen 30 than the left end of projection device 10B. Furthermore, in the view of the drawing, the projection device 10 installed on the right side facing the screen 30 will be denoted as projection device 10C. In the view of the drawing, the projection device 10C shown in Figure 5 is installed at an angle to the screen 30 such that the left end of the projection device 10C is further away from the screen 30 than the right end of the projection device 10C.

[0036] The control unit 180 calculates the angle α between the screen 30 and the projection device 10, and then controls the output of the left speaker 175A and the right speaker 175B based on the calculated angle α.

[0037] User H is positioned behind the projection device 10 and approximately in the center of the screen 30 in the width direction, and views the image projected onto the screen 30 by the projection device 10. The control unit 180 reduces the output of the right speaker 175B to less than the output of the left speaker 175A when the projection device 10 is installed in the state shown in Figure 5 (projection device 10B). In other words, the left speaker 175A is further away from the user H than the right speaker 175B. Therefore, the control unit 180 reduces the output of the right speaker 175B to less than the output of the left speaker 175A. One method for determining the output magnitudes of the left speaker 175A and the right speaker 175B is to determine the output magnitudes based on the calculated angle α(α1, α2) and trigonometric ratios. A specific example of this calculation method is to set the output of the left speaker 175A to 1 + sinα, assuming the output of the right speaker 175B is 1.

[0038] Furthermore, the control unit 180 reduces the output of the left speaker 175A to less than the output of the right speaker 175B when the projection device 10 is installed in the state shown in Figure 5 (projection device 10C). In other words, the right speaker 175B is further away from the user H than the left speaker 175A. For this reason, the output of the left speaker 175A is reduced to less than the output of the right speaker 175B.

[0039] Figure 6 shows an example where the projection device 10 is placed near a wall in a room. Furthermore, the control unit 180 detects objects within a preset distance from the projection device 10 based on the measurement data from the distance sensor 140. Figure 6 shows an example in which the projection device 10 is placed near a wall in a room.

[0040] When the control unit 180 detects an object within a preset distance from the projection device 10, it controls the output of the speaker 175 based on the distance between the detected object and the projection device 10. For example, as shown in Figure 6, if there is a wall to the right of the projection device 10 in the drawing view, the control unit 180 controls the output of speaker 175 so that the output of the right speaker 175B is smaller than the output of the left speaker 175A. The output of the right speaker 175B, which is closer to the wall, will be reflected off the wall and heard by user H as a louder sound. In this case, the control unit 180 makes the output of the right speaker 175B smaller than the output of the left speaker 175A.

[0041] Furthermore, when the control unit 180 causes the distance sensor 140 to measure distance, it drives the drive unit 150 to rotate the main body 100. By rotating the main body 100 while causing the distance sensor 140 to measure distance, the distance to objects present around the projection device 10 can be measured around the entire circumference of the projection device 10.

[0042] Furthermore, the control unit 180 stops the projector 300 from projecting images onto the screen 30 at regular intervals. After that, the control unit 180 drives the drive unit 150 to rotate the main unit 100 and causes the imaging unit 160 to perform imaging. The imaging unit 160 performs imaging, generates an image, and outputs the generated image to the control unit 180. The control unit 180 analyzes the image input from the imaging unit 160 and determines whether or not there are people around the projection device 10. If the control unit 180 determines, as a result of the image analysis, that there are no people around the projection device 10, it mutes the output of the speaker 175.

[0043] [2. Operation of the projection device] Figure 7 is a flowchart showing the operation of the projection device 10. The operation of the projection device 10 will be explained with reference to the flowchart shown in Figure 7. First, the control unit 180 determines whether or not it has received an operation from the remote control 135 to instruct the setting of the audio output (step S1). If the control unit 180 has not received an operation from the remote control 135 to instruct the setting of the audio output (step S1 / NO), it waits until it receives this operation.

[0044] When the control unit 180 receives an operation from the remote control 135 to instruct the setting of the audio output (step S1 / YES), it outputs a drive instruction to the drive unit 150 (step S2) to rotate the main unit 100 horizontally. The control unit 180 also causes the distance sensor 140 to perform distance measurement (step S3).

[0045] Next, the control unit 180 acquires measurement data from the distance sensor 140 and calculates the tilt of the projection device 10 relative to the screen 30 based on the acquired measurement data (step S4).

[0046] Next, the control unit 180 sets the output of the left and right speakers 175 based on the calculated tilt (step S5).

[0047] Next, the control unit 180 determines whether or not it has received image data from the information processing device via the communication I / F 110 (step S6). If the control unit 180 has not received image data (step S6 / NO), it waits until it receives image data.

[0048] When the control unit 180 receives image data from the information processing device (step S6 / YES), it generates image light based on the received image data and projects the generated image light onto the screen 30 (step S7). Furthermore, the control unit 180 outputs sound from the left speaker 175A and the right speaker 175B according to the setting in step S5 (step S8). At this time, the control unit 180 controls the volume of the sound output from the left speaker 175A and the right speaker 175B.

[0049] Next, the control unit 180 determines whether a certain amount of time has elapsed since the projector 300 began projecting the image light (step S9). If the control unit 180 determines that a certain amount of time has not elapsed (step S9 / NO), it waits until that time has elapsed.

[0050] After a certain period of time has elapsed (step S9 / YES), the control unit 180 stops projecting image light and outputting sound from the projector 300 (step S10), outputs a drive command to the drive unit 150 (step S11), and rotates the main unit 100.

[0051] Next, the control unit 180 instructs the imaging unit 160 to take an image (step S12). The imaging unit 160 starts taking an image in accordance with the instructions of the control unit 180. The imaging unit 160 generates an image and outputs the generated image to the control unit 180.

[0052] The control unit 180 acquires the captured image input from the imaging unit 160. The control unit 180 analyzes the acquired captured image and detects a person captured in the image (step S13). If the control unit 180 detects a person in the captured image (step S14 / YES), it resumes image projection and sound output (step S15).

[0053] Furthermore, if the control unit 180 is unable to detect a person from the captured image (step S14 / NO), it resumes projecting the image (step S15) and mutes the audio output from the speaker 175 (step S16).

[0054] Next, the control unit 180 determines whether or not it has received an operation of the end button on the remote control 135 (step S18). If the control unit 180 has not received an operation of the end button (step S18 / NO), it returns to the determination in step S9. If the control unit 180 has received an operation of the end button (step S18 / YES), it terminates the projection of the image to the projector 300 and stops the audio output to the speaker 175, thereby ending this processing flow.

[0055] [3. Other Embodiments] In the embodiment described above, a configuration in which the projection device 10 is equipped with a speaker 175 was described, but the speaker 175 may be provided separately from the projection device 10. In this case, for example, the projection device 10 projects a user interface image onto the screen 30 that includes a figure corresponding to the projection device 10 and accepts an operation to specify the position of the speaker 175. The user specifies the position of the speaker 175 relative to the projection device 10 by operating the remote control 135 or an operation unit (not shown) provided on the projection device 10.

[0056] Each of the embodiments described above is a preferred embodiment of the present invention. However, the invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the invention. For example, in the embodiment described above, the processor 195 of the projection device 10 calculated the tilt of the projector 300 relative to the screen 30 and controlled the output of the speaker 175 based on the calculated tilt. In addition to this configuration, an information processing device such as a personal computer may be connected to the projection device 10 by wire or wireless connection, and the information processing device may perform the processing that the processor 195 of the projection device 10 has performed. In this case, the information processing device acquires measurement data from the distance sensor 140 from the projection device 10, calculates the tilt of the projector 300 relative to the screen 30, and transmits data to the projection device 10 instructing it to set the output of the speaker 175 based on the calculated tilt.

[0057] Furthermore, the functional units of the projection device 10 shown in Figure 2 represent a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily required that hardware corresponding to each functional unit be implemented individually, and it is certainly possible to have a configuration in which a single processor executes a program to realize the functions of multiple functional units. Also, in the above embodiment, some of the functions realized by software may be realized by hardware, and vice versa.

[0058] Furthermore, the processing units in the flowchart shown in Figure 7 are divided according to the main processing content in order to facilitate understanding of the operation of the projection device 10, and the present invention is not limited by the way the processing units are divided or the names of the processing units shown in the flowchart in Figure 7. In addition, the processing of the projection device 10 can be further divided into more processing units depending on the processing content, or it can be divided so that one processing unit includes even more processing. Also, the processing order in the flowchart above is not limited to the example shown.

[0059] Furthermore, although the projection device 10 shown in Figure 4 has a distance sensor 140 positioned on the optical axis, the distance sensor 140 may be positioned at a location other than the optical axis of the projection device 10. For example, the distance sensor 140 may be positioned at the edge of the projection device 10. However, if the distance sensor 140 is positioned at a location other than the optical axis of the projection device 10, a correction will be necessary to convert the measurement data from the distance sensor 140 into a distance along the optical axis.

[0060] Furthermore, while it is stated that the control unit 180 makes the output of the right speaker 175B smaller than the output of the left speaker 175A when the projection device 10 is installed in the state shown in Figure 5 (projection device 10B), the output of the right speaker 175B may also be made larger than the output of the left speaker 175A. In other words, the output of the speaker closer to the screen 30 is made smaller than that of the speaker further away. This reduces the amount of reflected sound from the screen 30. One example of a method for determining the output magnitudes of the left speaker 175A and the right speaker 175B in this case is to determine the output magnitudes based on the calculated angle α(α1, α2) and trigonometric ratios. One specific example of a calculation method is to set the output of the right speaker 175B to 1 + sinα and the output of the left speaker 175A to 1. The projection device 10C can also be controlled in the same manner as described above.

[0061] Furthermore, while Figure 3 shows a configuration in which the projector 300 is equipped with transmissive liquid crystal panels 330R, 330G, and 330B, the optical modulator may, for example, be configured using three reflective liquid crystal panels 330, or a system combining one liquid crystal panel and a color wheel may be used. Alternatively, it may be configured using a system with three digital mirror devices, or a DMD system combining one digital mirror device and a color wheel. When using only one liquid crystal panel 330 or a DMD as the optical modulator, components equivalent to a composite optical system such as a cross dichroic prism are not required. In addition, any optical modulator capable of modulating light emitted from a light source can be used without any problems, other than the liquid crystal panels 330 and DMD.

[0062] Furthermore, when the program of this disclosure is to be executed by the processor 195 of the projection device 10, the program to be executed by the processor 195 can also be configured in the form of a recording medium. Alternatively, the program to be executed by the processor 195 can also be configured in the form of a transmission medium for transmitting the program. Magnetic, optical, or semiconductor memory devices can be used as the recording medium. Specifically, examples include portable or fixed recording media such as flexible disks, HDDs, CD-ROMs (compact disc read-only memory), DVDs (Digital Versatile Discs), Blu-ray Discs, magneto-optical disks, flash memory, and card-type recording media. The recording media may also be non-volatile storage devices such as RAM, ROM, or HDDs, which are internal storage devices of a server device. Blu-ray is a registered trademark.

[0063] [4. Summary of this disclosure] A summary of this disclosure is provided below. (Note 1) A projection device comprising: a distance sensor that measures the distance to multiple positions on a projection surface and outputs a measured value indicating the distance to the measured multiple positions; multiple speakers; one or more processors; and a projector that projects an image onto the projection surface, wherein the one or more processors perform the following: calculate the tilt of the projector relative to the projection surface based on the measured value output by the distance sensor; and control the output of the multiple speakers based on the tilt.

[0064] In this configuration, the tilt of the projector relative to the projection surface is calculated based on the measurement output by the distance sensor, and the output of multiple speakers is controlled based on the calculated tilt. As a result, the volume of sound heard from multiple speakers can be adjusted, providing a comfortable sound environment for users viewing the projected image on the projection surface.

[0065] (Note 2) The projection device according to Appendix 1, wherein the one or more processors detect objects present around the projection device based on measurements output by the distance sensor, and control the output of the multiple speakers based on the distance to the detected objects.

[0066] With this configuration, when objects are present around the projection device, the output of multiple speakers is controlled based on the distance to these objects. Therefore, the output of multiple speakers can be controlled to take into account sound reflected by objects surrounding the projection device, providing a comfortable sound environment for users viewing the projected image.

[0067] (Note 3) The projection device comprises a main body housing at least a part of the projector, and a drive unit that rotates the main body in a predetermined direction, wherein the one or more processors cause the drive unit to rotate the main body in a predetermined direction and cause the distance sensor to perform a measurement, as described in Appendix 1 or 2.

[0068] With this configuration, the main unit is rotated in a predetermined direction while the distance sensor performs measurements, allowing for accurate detection of objects present in multiple directions around the projection device. This provides a comfortable sound environment for users viewing the projected image on the projection surface.

[0069] (Note 4) The projection device is equipped with a detection sensor that detects the presence or absence of people around the projection device, and the one or more processors rotate the main body in a predetermined direction using the drive unit to determine whether or not there are people around the projection device based on the detection result of the detection sensor, and if it is determined that there are no people around the projection device, the projection device mutes the output of the multiple speakers as described in Appendix 3.

[0070] In this configuration, the system determines whether or not there are people around the projection device based on the detection results of the detection sensors. If it is determined that there are no people around the projection device, the output of multiple speakers is muted. Therefore, the sound can be muted when there are no users nearby who are viewing the image projected by the projection device.

[0071] (Note 5) A projection system comprising: a plurality of speakers; a projection device; the projection device comprising: a distance sensor that measures the distance to a plurality of positions on the projection surface and outputs a measured value indicating the distance to the plurality of positions; one or more processors; and a projector that projects an image onto the projection surface; wherein the one or more processors perform the following: calculate the tilt of the projector relative to the projection surface based on the measured value output by the distance sensor; and control the output of the plurality of speakers based on the tilt.

[0072] In this configuration, the tilt of the projector relative to the projection surface is calculated based on the measurement output by the distance sensor, and the output of multiple speakers is controlled based on the calculated tilt. As a result, the volume of sound heard from multiple speakers can be adjusted, providing a comfortable sound environment for users viewing the projected image on the projection surface.

[0073] (Note 6) A program to be executed by a processor mounted on an information processing device, the program to cause the processor to calculate the inclination of a projection device that projects an image onto the projection surface with respect to the projection surface, based on the distances to multiple positions on the projection surface measured by a distance sensor, and to control the output of multiple speakers based on the calculated inclination.

[0074] In this configuration, the tilt of the projection device relative to the projection surface is calculated based on the measurement value output by the distance sensor, and the output of multiple speakers is controlled based on the calculated tilt. As a result, the volume of sound heard from the multiple speakers can be adjusted, providing a comfortable sound environment for users viewing the projected image on the projection surface. [Explanation of symbols]

[0075] 10, 10A, 10B, 10C...Projection device, 20...Network, 30, 30V...Screen, 100...Main unit, 110...Communication interface, 120...Image processing unit, 125...Frame memory, 130...Remote control receiver, 135...Remote control, 136...Remote control, 140...Distance sensor, 150...Drive unit, 160...Imaging unit, 170...Audio processing unit, 175...Speaker, 175A...Left speaker, 175B...Right speaker, 180...Control unit, 191...Storage unit, 193...Control program, 195...Processor, 200...Base unit, 210A, 210B support members, 300...Projector, 310...Light source, 330, 330R, 330G, 330B...Liquid crystal panel, 350...Optical unit, 370...Panel drive unit, H...User, OA...Optical axis direction, OB...Normal.

Claims

1. A distance sensor that measures the distance to multiple positions on the projection surface and outputs a measured value indicating the distance to the measured multiple positions, Multiple speakers, One or more processors, A projector that projects an image onto the aforementioned projection surface, Equipped with, The one or more processors described above are: The tilt of the projector relative to the projection surface is calculated based on the measurement value output by the distance sensor, Controlling the output of the multiple speakers based on the aforementioned tilt, A projection device that performs this task.

2. The one or more processors described above are: The projection device according to claim 1, wherein the projection device detects objects present around it based on the measurement values ​​output by the distance sensor, and controls the output of the plurality of speakers based on the distance to the detected objects.

3. The projection device is A main body that houses at least a part of the aforementioned projector, A drive unit that rotates the main body in a predetermined direction, Equipped with, The one or more processors described above are: The projection device according to claim 1, wherein the drive unit rotates the main body in a predetermined direction, causing the distance sensor to perform a measurement.

4. The projection device is equipped with a detection sensor that detects the presence or absence of people around the projection device. The one or more processors described above are: The drive unit rotates the main body in a predetermined direction and determines whether or not there is a person around the projection device based on the detection result of the detection sensor. The projection device according to claim 3, which mutes the output of multiple speakers when it is determined that there are no people around the projection device.

5. Equipped with multiple speakers and a projection device, The projection device is A distance sensor that measures the distance to multiple positions on the projection surface and outputs a measured value indicating the distance to the measured multiple positions, One or more processors, A projector that projects an image onto the aforementioned projection surface, Equipped with, The one or more processors described above are: The tilt of the projector relative to the projection surface is calculated based on the measurement value output by the distance sensor, Controlling the output of the multiple speakers based on the aforementioned tilt, A projection system that performs this task.

6. A program to be executed by a processor installed in an information processing device, The aforementioned processor, Based on the distances to multiple positions on the projection surface measured by a distance sensor, the tilt of the projection device that projects an image onto the projection surface is calculated relative to the projection surface. Controlling the output of multiple speakers based on the calculated slope, A program that executes something.

Images