Display system and volume control method

Abstract

To provide a display system that allows users to easily adjust volume settings according to their preferences. [Solution] The display system comprises a display device and an information processing device. The information processing device transmits a volume adjustment start request to the display device. The display device transmits first volume setting information to the information processing device and then causes the speaker to output a test sound. The information processing device acquires volume measurement information based on sound data acquired by the microphone. The information processing device acquires second volume setting information stored in the storage unit. If the second volume setting information and the volume measurement information do not match, the attenuation rate is calculated based on the first volume setting information and the volume measurement information. The third volume setting information is generated based on the second volume setting information and the attenuation rate. The third volume setting information is transmitted to the display device. The display device updates the volume setting value based on the third volume setting information.

Description

Technical Field

[0001] The present invention relates to a display system including a display device and an information processing device, and to a volume adjustment method.

Background Art

[0002] For example, Patent Document 1 discloses an audio output device including a display unit, wherein a detection unit detects a person present in a region where the display unit is visible as a viewer. According to said document, the display unit is a television set, the detection unit is a camera, and the sound field is controlled in accordance with the viewing position of the viewer. It is also described that the age of the viewer is estimated and calculated based on detected image information of the face, statistical data on age-related hearing loss is referred to, and when it is determined that the viewer is elderly, the volume is increased, and the volume in a high-frequency band is also increased.

Prior Art Literature

Patent Literature

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] However, the audio output device of Patent Document 1 has a problem that it is difficult to set a volume desired by a viewer. More specifically, in the method of typologically adjusting volume based on factors such as the position and age of the viewer, individual perception of the viewer and ambient environmental sound are not taken into consideration, so there is a risk that the volume setting does not match what the viewer desires. That is, there has been a demand for a display system and a volume adjustment method that can easily perform volume setting in accordance with a user's desire.

Means for Solving the Problem

[0005] A display system according to one aspect of the present invention comprises a display device equipped with a speaker, an information processing device equipped with a microphone and a storage unit, wherein the information processing device transmits a volume adjustment start request to the display device, the display device transmits first volume setting information to the information processing device, the display device causes the speaker to output a test sound, the information processing device acquires volume measurement information based on sound data acquired by the microphone, the information processing device acquires second volume setting information stored in the storage unit, if the second volume setting information and the volume measurement information do not match, the information processing device calculates an attenuation rate based on the first volume setting information and the volume measurement information, the information processing device generates third volume setting information based on the second volume setting information and the attenuation rate, the information processing device transmits the third volume setting information to the display device, and the display device updates the volume setting value based on the third volume setting information.

[0006] A volume adjustment method according to one aspect of the present invention includes: transmitting a volume adjustment start request to a display device equipped with a speaker using an information processing device equipped with a microphone and a storage unit; transmitting first volume setting information to the information processing device using the display device; causing the speaker to output a test sound using the display device; acquiring volume measurement information based on sound data acquired by the microphone using the information processing device; acquiring second volume setting information stored in the storage unit using the information processing device; if the second volume setting information and the volume measurement information do not match, calculating an attenuation rate based on the first volume setting information and the volume measurement information using the information processing device; generating third volume setting information based on the second volume setting information and the attenuation rate using the information processing device; transmitting the third volume setting information to the display device using the information processing device; and updating the volume setting value based on the third volume setting information using the display device. [Brief explanation of the drawing]

[0007] [Figure 1]A schematic diagram of the display system according to Embodiment 1. [Figure 2] A block diagram showing the general configuration of the display system. [Figure 3] A flowchart illustrating the flow of the first adjustment method. [Figure 4] A flowchart illustrating the flow of the second adjustment method according to Embodiment 2. [Figure 5] A diagram showing an example of the operation screen. [Figure 6] A diagram showing an example of the operation screen. [Figure 7] A flowchart illustrating the flow of the third adjustment method according to Embodiment 3. [Figure 8] A diagram showing an example of a guidance screen. [Figure 9] A table showing an example of a correlation table between distance and volume level. [Figure 10] A flowchart illustrating the flow of the fourth adjustment method according to Embodiment 4. [Figure 11] A diagram showing an example of the operation screen. [Figure 12] A table showing an example of a correlation table between volume level and sound level coefficient. [Modes for carrying out the invention]

[0008] Embodiment 1 ***Overview of the display system*** Figure 1 is a schematic diagram of the display system according to Embodiment 1. Embodiments of the present invention will be described below with reference to the drawings. The following embodiments illustrate just one example of the present invention and are not limited to the embodiments described below. Various modifications that can be implemented without changing the gist of the present invention are also included in the present invention. In addition, in the following drawings, dimensions and scales may differ from those of the actual objects for the sake of clarity in the explanation.

[0009] As shown in Figure 1, the display system 100 consists of a projection device 40 and an information processing device 80, which are used as display devices. The projection device 40 is, for example, a stationary projector that projects an image specified in the image data. In Figure 1, the projection device 40 projects an image onto a rectangular screen SC installed on the wall of a conference room. The projection device 40 is equipped with a speaker unit 48. In a preferred example, the speaker unit 48 is a stereo type with a pair of speakers. The speaker unit 48 only needs to be configured to output sound, and may have three or more speakers, or may be a monaural type.

[0010] The information processing device 80 is a smartphone and includes a display unit 83, an imaging unit 84, a microphone unit 85, a speaker unit 86, and the like. The display unit 83 is rectangular in shape and is equipped with a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 83 is equipped with a touch panel and also functions as an operation unit 89. An operation button 89b is provided below the display unit 83. The operation button 89b is part of the operation unit 89 and is the power button for starting up the information processing device 80. The operation button 89b may also have a fingerprint authentication function. A microphone unit 85 is provided on the side of the housing near the operation button 89b. The speaker unit 86 is located next to the imaging unit 84. The information processing device 80 is not limited to a smartphone, but can be any portable information processing device with similar functions, such as a notebook computer or a tablet computer. In a preferred example, the projection device 40 and the information processing device 80 are able to communicate bidirectionally via a wireless LAN (Local Area Network). The display device is not limited to a projector; any device capable of displaying images and outputting sound from a location away from the information processing device 80 may be used, such as a television or monitor.

[0011] ***Projection device configuration*** Figure 2 is a block diagram showing the schematic configuration of the display system. As shown in Figure 2, the projection device 40 includes a control unit 41, a storage unit 42, a communication unit 43, an operation unit 44, an IF unit 45, an image processing unit 46, a projection unit 47, a speaker unit 48, a light emitting unit 49, and the like. The control unit 41 is connected to each of the above units via a system bus 90. The control unit 41 includes one or more processors, and performs overall control of the operation of the projection device 40 by operating in accordance with a control program stored in the storage unit 42.

[0012] The storage unit 42 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporary storage of various types of data, and the ROM stores control programs, control data, and the like for controlling the operation of the projection device 40. The control data includes coordinate data of the four corners of a projected image. The communication unit 43 includes a wireless communication device for performing wireless communication via wireless LAN, Bluetooth (registered trademark), or the like. The communication unit 43 transmits and receives information to and from the information processing apparatus 80 via wireless connection under the control of the control unit 41.

[0013] The operation unit 44 includes a plurality of operation keys for a user to issue various instructions to the projection device 40. The operation keys included in the operation unit 44 include a "power key" for switching power on and off, a "menu key" for displaying a menu for performing various settings, and a "direction key" for selecting menu items. The operation unit 44 is provided with a plurality of indicators 44a (FIG. 1) that notify the operating state by lighting color, blinking, or the like. The indicator 44a is formed of an LED (Light Emitting Diode).

[0014] The IF unit 45 is an interface section with external equipment, and includes a plurality of connection terminals including an HDMI (registered trademark, High-Definition Multimedia Interface) terminal. As the plurality of connection terminals, for example, a USB (Universal Serial Bus) terminal, a VGA (Video Graphics Array) terminal, or the like may be further included.

[0015] The image processing unit 46 performs necessary image processing on input image information under the control of the control unit 41, and outputs the processed image information to the projection unit 47. The image processing includes image processing for correcting distortion of a projected image in accordance with correction parameters received from the information processing apparatus 80.

[0016] The projection unit 47 is composed of a light source, a light modulation device, a projection optical system (none of which are shown), and the like. The projection unit 47 modulates light emitted from the light source with the light modulation device to form image light defined by image information, and projects the image light from the projection optical system. For the light modulation device, for example, a liquid crystal panel or a Digital Micromirror Device can be employed. The light modulation device may be a single liquid crystal panel or a single digital micromirror device, or may include a plurality of liquid crystal panels or a plurality of digital micromirror devices. The projection optical system includes one or more optical elements that adjust the magnification ratio and image forming position of light output from the light modulation device.

[0017] The speaker unit 48 is an audio output unit, and in a preferred example, is a stereo type including a pair of speakers. The light emitting unit 49 is a light emitting unit formed of an LED, and for example, lights up in red. Note that the lighting color is not limited to red, and any color tone is acceptable as long as the unit lights up at a predetermined luminance.

[0018] The control unit 41 and the image processing unit 46 may be composed of one or more processors, or they may be composed of dedicated processing devices such as ASICs (Application Specific Integrated Circuits) or FPGAs (Field Programmable Gate Arrays).

[0019] ***Configuration of the Information Processing Device*** As shown in Figure 2, the information processing device 80 consists of a control unit 81, a storage unit 82, a display unit 83, an imaging unit 84, a microphone unit 85, a speaker unit 86, a first communication unit 87, a second communication unit 88, an operation unit 89, and the like. The control unit 81 is connected to each of the above units via a system bus 91.

[0020] The control unit 81 is comprised of one or more processors. The control unit 81 operates according to the OS (Operating System) and control programs stored in the memory unit 82, thereby providing overall control over the operation of the information processing device 80. The storage unit 82 consists of memory such as RAM and ROM. The storage unit 82 stores the OS, control programs, and various data. The control programs include the first adjustment program 82a, the second adjustment program 82b, the third adjustment program 82c, and the fourth adjustment program 82d. The various data include operation screen data 82e and data tables 82f.

[0021] The display unit 83 is configured with a display device such as a liquid crystal display or an organic EL display, and displays an image based on image information. The imaging unit 84 is an RGBD camera equipped with an image sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor and a depth sensor. The imaging unit 84 has the function of providing both depth information data and RGB data in a single frame. The imaging unit 84 performs imaging based on the control of the control unit 81, and the captured image data is stored in the storage unit 82.

[0022] The microphone unit 85 is a built-in microphone, for example, a small dynamic microphone. The microphone unit 85 may also be a condenser microphone. The speaker unit 86 is a built-in, small speaker.

[0023] The first communication unit 87 is a communication unit that transmits and receives data to and from the nearest base station (not shown) via an antenna, based on a fourth-generation mobile communication system compliant with the IMT-Advance standard and / or a fifth-generation mobile communication system compliant with the IMT-2020 standard. The second communication unit 88 is configured to include wireless communication devices for wireless communication using wireless LAN, Bluetooth (registered trademark), etc. Based on the control of the control unit 81, the second communication unit 88 transmits and receives information wirelessly with the projection device 40.

[0024] The control unit 89 includes a touch panel integrated with the display unit 83 and operation buttons 89b, and accepts user input. When the user operates the control unit 89, the control unit 89 outputs an operation signal corresponding to the operation to the control unit 81 via the system bus 91. In other words, the display system 100 includes a projection device 40 as a display device equipped with a speaker unit 48, an information processing device 80 equipped with a microphone unit 85 and a storage unit 82.

[0025] ***First method of adjusting the volume*** Figure 3 is a flowchart illustrating the flow of the first adjustment method. Here, we will explain a first adjustment method for adjusting the volume of the speaker section 48 of the projection device 40 using the information processing device 80, primarily using Figure 3, and including other drawings as appropriate. For example, as shown in Figure 1, when a user viewing projected images and sound from a projection device 40 in a conference room from a location away from the projection device 40, it would be convenient if the user could adjust the projected images and sound using an information processing device 80 held by the user. In a preferred example, when the user runs a setup application on the information processing device 80, the first adjustment method is performed, following distortion correction of the projected image and adjustment of the brightness and image quality of the projected image, so that the projected image fits the screen SC. In distortion correction, a test image such as a checkerboard pattern is projected, and geometric correction of the projected image is performed using the image data captured from the test image. Note that the first adjustment method is not limited to being performed as part of a setup application, but may also be performed independently.

[0026] Each of the following steps is performed by the information processing device 80 executing the first adjustment program 82a. Specifically, the first adjustment program 82a is executed when the user operates the volume adjustment program icon displayed on the display unit 83 of the information processing device 80. When the first adjustment program 82a is executed, the information processing device 80 and the projection device 40 are wirelessly connected, and the projection device 40 operates according to commands from the information processing device 80. In the following description, the main entities executing each step are the control unit 81 of the information processing device 80 and the control unit 41 of the projection device 40.

[0027] In step S30, the information processing device 80 sends a request to start volume adjustment to the projection device 40. More specifically, the information processing device 80 sends the request to start volume adjustment from the second communication unit 88. In other words, the information processing device 80 sends a request to start volume adjustment to the projection device 40, which acts as a display device.

[0028] In step S50, the projection device 40 determines whether or not it has received data from the information processing device 80. If data has been received, it proceeds to step S51. If no data has been received, it continues to wait for data from the information processing device 80. Note that the determination of whether or not data has been received from the information processing device 80 is also performed in subsequent flows, but the description of the subsequent determination process is omitted.

[0029] In step S51, the projection device 40 reads the volume setting data for the speaker unit 48 stored in the memory unit 42 and transmits it to the information processing device 80. The volume setting data of the projection device 40 is the first volume setting information, also called the Pr volume setting value. In step S52, the projection device 40 outputs a test sound from the speaker unit 48 based on the read volume setting data. The test sound is a beep at a predetermined frequency within the audible frequency range. In other words, the projection device 40 transmits the Pr volume setting value as first volume setting information to the information processing device 80. Then, the projection device 40 causes the speaker unit 48 to output a test sound.

[0030] In step S31, the information processing device 80 receives the Pr volume setting value and stores it in the storage unit 82. In step S32, the information processing device 80 uses the microphone unit 85 to capture the test sound emitted from the projection device 40 and stores it in the storage unit 82. The test sound also includes ambient sounds. In step S33, the information processing device 80 analyzes the recorded data stored in the storage unit 82, measures the volume of a predetermined frequency which is the frequency of the test sound, and stores the volume measurement value in the storage unit 82. In other words, the volume measurement value is volume information extracted from the sound data acquired by the microphone unit 85 for a predetermined frequency. In step S34, the information processing device 80 reads the volume setting data for the speaker unit 86 stored in the memory unit 82. The volume setting data of the information processing device 80 is second volume setting information, also called the Sm volume setting value. In other words, the information processing device 80 obtains a volume measurement value as volume measurement information based on the sound data acquired by the microphone unit 85. Then, the information processing device 80 obtains the Sm volume setting value, which is the second volume setting information stored in the memory unit 82.

[0031] In step S35, the information processing device 80 determines whether the Sm volume setting value and the volume measurement value match. If they match, there is no need to adjust the volume, and the adjustment process is terminated. If they do not match, the process proceeds to step S36. Here, since the Sm volume setting value is set by the user to their preferred volume, taking into account the influence of ambient noise, if the Sm volume setting value and the volume measurement value match, it is determined that the volume setting of the projection device 40 is appropriate.

[0032] In step S36, the information processing device 80 calculates the attenuation rate based on the Pr volume setting value and the volume measurement value. Specifically, the control unit 81 of the information processing device 80 is made to function as the calculation unit 81a, and the attenuation rate is calculated using the following formula (1). Attenuation rate = (Pr volume setting value - measured volume value) ÷ Pr volume setting value ... Equation (1)

[0033] In step S37, the information processing device 80 generates a new Pr volume setting value based on the Sm volume setting value and the attenuation rate obtained by formula (1). Specifically, the control unit 81 of the information processing device 80 is made to function as a calculation unit 81a, and the new Pr volume setting value is calculated by the following formula (2). Pr new volume setting value = Sm volume setting value ÷ (1 - attenuation rate) ... Equation (2)

[0034] In step S38, the information processing device 80 transmits the Pr new volume setting value obtained using formula (2) to the projection device 40. In other words, if the Sm volume setting value, which is the second volume setting information, does not match the measured volume value, the information processing device 80 calculates the attenuation rate based on the Pr volume setting value and the measured volume value. Then, the information processing device 80 generates a new Pr volume setting value, which is the third volume setting information, based on the Sm volume setting value and the attenuation rate. Subsequently, the information processing device 80 transmits the new Pr volume setting value to the projection device 40.

[0035] In step S53, the projection device 40 receives the new Pr volume setting value from the information processing device 80. In step S54, the projection device 40 updates the volume setting data of the speaker unit 48 in the memory unit 42 with the received Pr new volume setting value and stores it. Alternatively, a test sound based on the Pr new volume setting value may be output from the speaker unit 48.

[0036] In other words, the method for adjusting the volume of the projection device 40 as a display device, which is performed by the information processing device 80 of the display system 100 executing the first adjustment program 82a, is as follows: The volume adjustment method includes: sending a volume adjustment start request to a projection device 40, which is a display device equipped with a speaker unit 48, via an information processing device 80 equipped with a microphone unit 85 and a storage unit 82; the projection device 40 sending a Pr volume setting value as first volume setting information to the information processing device 80; the projection device 40 causing the speaker unit 48 to output a test sound; the information processing device 80 obtaining a volume measurement value as volume measurement information based on sound data acquired by the microphone unit 85; the information processing device 80 obtaining an Sm volume setting value as second volume setting information stored in the storage unit 82; if the Sm volume setting value and the volume measurement value do not match, the information processing device 80 calculating an attenuation rate based on the Pr volume setting value and the volume measurement value; the information processing device 80 generating a new Pr volume setting value as third volume setting information based on the Sm volume setting value and the attenuation rate; the information processing device 80 sending the new Pr volume setting value to the projection device 40; and the projection device 40 updating the volume setting value based on the new Pr volume setting value.

[0037] As described above, the display system 100 and volume adjustment method of this embodiment provide the following benefits. The display system 100 includes a projection device 40 as a display device equipped with a speaker unit 48, an information processing device 80 equipped with a microphone unit 85 and a storage unit 82. The information processing device 80 transmits a volume adjustment start request to the projection device 40 as a display device, the projection device 40 transmits a Pr volume setting value as first volume setting information to the information processing device 80, the projection device 40 outputs a test sound via the speaker unit 48, and the information processing device 80 calculates a volume measurement value as volume measurement information based on the sound data acquired by the microphone unit 85. The information processing device 80 acquires the Sm volume setting value, which is the second volume setting information stored in the storage unit 82. If the Sm volume setting value and the volume measurement value do not match, the information processing device 80 calculates the attenuation rate based on the Pr volume setting value and the volume measurement value. Based on the Sm volume setting value and the attenuation rate, the information processing device 80 generates a new Pr volume setting value as the third volume setting information. The information processing device 80 transmits the new Pr volume setting value to the projection device 40, and the projection device 40 updates the volume setting value based on the new Pr volume setting value.

[0038] In the above process, a test sound based on the Pr volume setting value set in the projection device 40 is acquired by the microphone unit 85 of the information processing device 80, which is the user's smartphone. The system then checks whether the Sm volume setting value, which is the volume setting information of the speaker unit 86 pre-set in the information processing device 80, matches the volume measurement value acquired by the microphone unit 85. Here, the Sm volume setting value is a comfortable volume setting that the user uses on a daily basis. If the two do not match, a new volume setting value, the Pr new volume setting value, is generated using formulas (1) and (2) and set in the projection device 40. According to this, the volume output by the projection device 40 according to the Pr new volume setting value will be equivalent to the volume according to the Sm volume setting value at the location of the information processing device 80 held by the user. The Sm volume setting value is set by the user to their preferred volume, taking into account the influence of ambient noise and other factors. Therefore, the user can easily adjust the volume of the projection device 40, which is a projector, to a comfortable listening level simply by running the dedicated application on the information processing device 80 at the viewing position. Therefore, we can provide a display system 100 that allows users to easily adjust the volume settings according to their preferences.

[0039] Furthermore, the test sound is a sound of a predetermined frequency, and the volume measurement value is volume information extracted from the sound data acquired by the microphone unit 85, specifically the sound of a predetermined frequency. According to this, even if ambient noise is included in the sound data acquired from the microphone unit 85, the test sound can be extracted and the volume can be accurately measured.

[0040] The volume adjustment method includes: sending a volume adjustment start request to a projection device 40, which is a display device equipped with a speaker unit 48, via an information processing device 80 equipped with a microphone unit 85 and a storage unit 82; the projection device 40 sending a Pr volume setting value as first volume setting information to the information processing device 80; the projection device 40 causing the speaker unit 48 to output a test sound; the information processing device 80 obtaining a volume measurement value as volume measurement information based on sound data acquired by the microphone unit 85; the information processing device 80 obtaining an Sm volume setting value as second volume setting information stored in the storage unit 82; if the Sm volume setting value and the volume measurement value do not match, the information processing device 80 calculating an attenuation rate based on the Pr volume setting value and the volume measurement value; the information processing device 80 generating a new Pr volume setting value as third volume setting information based on the Sm volume setting value and the attenuation rate; the information processing device 80 sending the new Pr volume setting value to the projection device 40; and the projection device 40 updating the volume setting value based on the new Pr volume setting value.

[0041] According to this, the user can simply run the dedicated app on the information processing device 80 at their viewing position, and the above volume adjustment method will be performed, allowing them to easily adjust the volume of the projection device 40, which is a projector, to a comfortable listening level. Therefore, it is possible to provide a volume adjustment method that allows users to easily adjust the volume to their preference.

[0042] Embodiment 2 ***Second method for adjusting the volume*** Figure 4 is a flowchart showing the flow of the second adjustment method according to Embodiment 2, and corresponds to Figure 3. Figure 5 is a diagram showing an example of the operation screen. Figure 6 is a diagram showing an example of the operation screen. In the above embodiment, it was described that the volume of the projection device 40 is automatically adjusted when the first adjustment program 82a is executed, but the invention is not limited to this, and an option to manually adjust the volume may be provided.

[0043] In the following, the same parts as in the above embodiment will be numbered, and redundant explanations will be omitted. The second adjustment method shown in Figure 4 differs from Embodiment 1 in that it allows selection between automatic and manual adjustment in the preceding step of the first adjustment method shown in Figure 3. Each of the following steps is performed by the information processing device 80 executing the second adjustment program 82b.

[0044] In step S10, an operation screen 51 (Figure 5) for selecting a volume adjustment method is displayed on the display unit 83 of the information processing device 80. Specifically, operation screen data is read from the operation screen data 82e in the storage unit 82 and displayed on the display unit 83. As shown in Figure 5, the operation screen 51 displays an operation icon 5a for automatic adjustment, an operation icon 5b for manual adjustment, and an operation icon 5c for exiting.

[0045] In step S11, the information processing device 80 accepts an operation on the operation screen 51 for selecting volume adjustment. In step S12, the information processing device 80 branches into an automatic adjustment or manual adjustment processing flow depending on the operation performed on the operation screen 51. Specifically, if operation icon 5a is tapped, the process proceeds to step S30 in Figure 3 and a series of automatic volume adjustment processes are performed. If operation icon 5b is tapped, the process proceeds to step S13. If operation icon 5c is tapped, the adjustment process is terminated.

[0046] In step S13, an operation screen 52 (Figure 6) for adjusting the volume is displayed on the display unit 83 of the information processing device 80. Specifically, operation screen data is read from the operation screen data 82e in the storage unit 82 and displayed on the display unit 83. As shown in Figure 6, the operation screen 52 displays an operation icon 6a for increasing the volume, an operation icon 6b for decreasing the volume, and an operation icon 6c for ending the operation.

[0047] In step S14, the information processing device 80 receives an operation on the volume adjustment screen 52 and increases or decreases the volume setting value according to the operation. In step S15, the information processing device 80 transmits the updated "new" volume setting value to the projection device 40. The "new" volume setting value corresponds to the fourth volume setting information.

[0048] In step S60, the projection device 40 receives a "new" volume setting value from the information processing device 80. In step S61, the projection device 40 updates the volume setting data from the speaker unit 48 of the memory unit 42 with the "new" volume setting value received and stores it. Alternatively, a test sound with the "new" volume setting value may be output from the speaker unit 48. In other words, the information processing device 80 displays an operation screen 51 which is a volume adjustment selection screen. When an operation icon 5b is tapped on the operation screen 51 and a request for manual volume adjustment is received, the information processing device 80 generates a "new" volume setting value as fourth volume setting information based on the volume adjustment operation by the user. The information processing device 80 then transmits the "new" volume setting value to the projection device 40, and the projection device 40 updates the volume setting value based on the "new" volume setting value.

[0049] As described above, the display system 100 and volume adjustment method of this embodiment can provide the following effects in addition to those of the above embodiment. According to the display system 100, the information processing device 80 displays an operation screen 51 which is a volume adjustment selection screen. When an operation icon 5b is tapped on the operation screen 51 and a request for manual volume adjustment is received, the information processing device 80 generates a "new" volume setting value as fourth volume setting information based on the volume adjustment operation by the user. The information processing device 80 then transmits the "new" volume setting value to the projection device 40, and the projection device 40 updates the volume setting value based on the "new" volume setting value.

[0050] According to this, the user can choose to manually adjust the volume. Specifically, the user can easily adjust the volume of the projection device 40 to a comfortable listening level by operating the volume adjustment selection screen on the information processing device 80. Therefore, we can provide a display system 100 that allows users to easily adjust the volume settings according to their preferences.

[0051] Embodiment 3 ***Third method of adjusting volume*** Figure 7 is a flowchart showing the flow of the third adjustment method according to Embodiment 3, and corresponds to Figure 3. Figure 8 is a diagram showing an example of a guidance screen. Figure 9 is a table showing an example of a correlation table between distance and volume level. In the above embodiment, the test sound from the projection device 40 was picked up by the microphone unit 85 of the information processing device 80 to obtain a volume measurement value. However, when the initial volume setting value of the projection device 40 was small, there was a problem in that it was difficult to pick up the test sound and obtain a volume measurement value. In view of this problem, the third adjustment method of this embodiment differs from Embodiment 1 in that, in the preceding step of the first adjustment method in Figure 3, a process is provided to set the initial volume setting value of the projection device 40 based on the relative distance between the projection device 40 and the information processing device 80.

[0052] In the following, the same parts as in the above embodiment will be numbered, and redundant explanations will be omitted. Each of the following steps is performed by the information processing device 80 executing the third adjustment program 82c.

[0053] In step S20, a guidance screen 53 (Figure 8) is displayed on the display unit 83 of the information processing device 80, prompting the user to take an image with the imaging unit 84 when the light-emitting unit 49 of the projection device 40 lights up. Specifically, the guidance screen data is read from the operation screen data 82e of the storage unit 82 and displayed on the display unit 83. As shown in Figure 8, the guidance screen 53 displays the message, "Adjust the projector volume. Take an image when the lamp lights up." In step S21, the information processing device 80 transmits a distance measurement start request to the projection device 40. The distance measurement start request is a command to turn on the light-emitting unit 49 of the projection device 40.

[0054] In step S70, the projection device 40 lights up the light-emitting unit 49 at a predetermined brightness. As shown in Figure 1, the light-emitting unit 49 is located on the upper rear of the projection device 40 and is positioned in a location visible to the user. Alternatively, one of the indicators 44a on the operation unit 44 (Figure 1) may be lit instead of the light-emitting unit 49. This would allow the light-emitting unit 49 for distance measurement to be omitted.

[0055] In step S22, the information processing device 80 captures an image of the projection device 40 with the light-emitting unit 49 lit. In step S23, the information processing device 80 analyzes the captured image to identify the area with the highest brightness as the light-emitting unit 49, and derives the distance to the projection device 40 from the depth information data of the captured image.

[0056] In step S24, the information processing device 80 refers to the distance / volume level correlation table 61 in Figure 9 and assigns the volume level corresponding to the derived distance. For example, if the distance is 4m, the volume level will be 10. If the distance is 7m, the volume level will be 16. For other distances, refer to the correlation table 61. In step S25, the information processing device 80 transmits the "new" volume setting value of the assigned volume level to the projection device 40. The "new" volume setting value corresponds to the fifth volume setting information.

[0057] In step S71, the projection device 40 receives a "new" volume setting value from the information processing device 80. In step S72, the projection device 40 updates the volume setting data of the speaker unit 48 in the memory unit 42 with the "new" volume setting value received and stores it. In step S73, the projection device 40 outputs a test sound from the speaker unit 48 based on the "new" volume setting.

[0058] In step S32, the process proceeds to step S32 in Figure 3, and the subsequent automatic volume adjustment process is performed. In other words, the information processing device 80 includes an imaging unit 84, and the projection device 40 includes a light-emitting unit 49. The information processing device 80 acquires imaging data including the light-emitting unit 49 using the imaging unit 84. Based on the depth information data included in the imaging data, the information processing device 80 transmits a "new" volume setting value as fifth volume setting information to the projection device 40, and the projection device 40 generates first volume setting information based on the "new" volume setting value.

[0059] As described above, the display system 100 and volume adjustment method of this embodiment can provide the following effects in addition to those of the above embodiment. According to the display system 100, the information processing device 80 includes an imaging unit 84, and the projection device 40 includes a light-emitting unit 49. The information processing device 80 acquires imaging data including the light-emitting unit 49 using the imaging unit 84, and based on the depth information data included in the imaging data, the information processing device 80 transmits a "new" volume setting value as fifth volume setting information to the projection device 40, and the projection device 40 generates first volume setting information based on the "new" volume setting value.

[0060] According to this, the distance between the projection device 40 and the viewing position of the user holding the information processing device 80 can be estimated based on the depth information data included in the imaging data, and the volume setting value of the projection device 40 can be optimized. Therefore, the subsequent automatic volume adjustment process can reliably capture test sounds and obtain volume measurement values. Therefore, we can provide a display system 100 that allows users to easily adjust the volume settings according to their preferences.

[0061] Embodiment 4 ***Fourth method for adjusting the volume*** Figure 10 is a flowchart showing the flow of the fourth adjustment method according to Embodiment 4, and corresponds to Figure 3. Figure 11 is a diagram showing an example of the operation screen. Figure 12 is a table showing an example of a correlation table between volume level and sound level coefficient. In Embodiment 1, if there are viewers other than the user holding the information processing device 80, it is conceivable that even if the adjusted volume is appropriate at the user's location, the volume may be too low for other viewers, requiring fine-tuning. In view of this point, the fourth adjustment method of this embodiment differs from Embodiment 1 in that it includes a process for fine-tuning the volume during the automatic volume adjustment process.

[0062] In the following, the same parts as in the above embodiment will be numbered, and redundant explanations will be omitted. Each of the following steps is performed by the information processing device 80 executing the fourth adjustment program 82d.

[0063] Steps up to S35 are the same as the processes from step S30 onwards in Figure 3. In step S35, the information processing device 80 determines whether the Sm volume setting value and the volume measurement value match. If they match, there is no need to adjust the volume, and the adjustment process is terminated. If they do not match, the process proceeds to step S41. In step S41, the information processing device 80 calculates the attenuation rate using the above formula (1). Step S41 is the same as step S36 in Figure 3.

[0064] In step S42, an operation screen 54 (Figure 11) for fine-tuning the volume is displayed on the display unit 83 of the information processing device 80. Specifically, operation screen data is read from the operation screen data 82e in the storage unit 82 and displayed on the display unit 83. As shown in Figure 11, the operation screen 54 displays an operation icon 7a for high volume, an operation icon 7b for medium volume, an operation icon 7c for low volume, and an operation icon 7d for exiting. In step S43, the information processing device 80 accepts an operation on the operation screen 54 for fine-tuning the volume.

[0065] In step S44, the information processing device 80 refers to the volume level / sound level coefficient correlation table 62 in Figure 12, finds the sound level coefficient corresponding to the operation, and calculates the "new" volume setting value using the following formula (3). "New" volume setting value = (Sm volume setting value × sound level coefficient) ÷ (1 - attenuation rate) ... Equation (3)

[0066] As shown in the correlation table 62 in Figure 12, when the medium volume control icon 7b is activated, the sound level coefficient is 1, resulting in the same volume setting as the automatically adjusted volume. When the low volume control icon 7c is activated, the sound level coefficient is 0.8, resulting in a volume setting slightly lower than the automatically adjusted volume. When the high volume control icon 7a is activated, the sound level coefficient is 1.2, resulting in a volume setting slightly higher than the automatically adjusted volume.

[0067] In step S45, the information processing device 80 transmits the "new" volume setting value calculated using formula (3) to the projection device 40.

[0068] In step S53, the projection device 40 receives a "new" volume setting value from the information processing device 80. In step S54, the projection device 40 updates the volume setting data from the speaker unit 48 of the memory unit 42 with the "new" volume setting value received and stores it. Alternatively, a test sound with the "new" volume setting value may be output from the speaker unit 48.

[0069] As described above, the display system 100 and volume adjustment method of this embodiment can provide the following effects in addition to those of the above embodiment. According to the fourth adjustment method, by providing a function to accept fine-tuning of the volume via the operation screen 54 in Figure 11 during the automatic volume adjustment process, the volume can be easily optimized when there are multiple viewers. Therefore, we can provide a display system 100 that allows users to easily adjust the volume settings according to their preferences.

[0070] ***Summary of this disclosure*** A summary of this disclosure is provided below. (Note 1) A display device equipped with a speaker, An information processing device comprising a microphone and a memory unit, The information processing device transmits a volume adjustment start request to the display device. The display device transmits the first volume setting information to the information processing device. The display device causes the speaker to output a test sound. The information processing device acquires volume measurement information based on the sound data acquired by the microphone. The information processing device acquires the second volume setting information stored in the storage unit, If the second volume setting information and the volume measurement information do not match, The information processing device calculates the attenuation rate based on the first volume setting information and the volume measurement information. The information processing device generates third volume setting information based on the second volume setting information and the attenuation rate. The information processing device transmits the third volume setting information to the display device, The display device updates the volume setting value based on the third volume setting information. Display system.

[0071] According to this, the volume output by the display device based on the third volume setting information will be equivalent to the volume based on the second volume setting information at the location of the information processing device held by the user. The second volume setting information is set by the user to their preferred volume, taking into account the influence of ambient noise and other factors. Therefore, users can easily adjust the volume of a display device located at a distance, such as a projector, to a comfortable listening level simply by running a dedicated app on the information processing device at their viewing position. Therefore, we can provide a display system that allows users to easily adjust the volume settings to their preferences.

[0072] (Note 2) The aforementioned test sound is a sound of a predetermined frequency, The aforementioned volume measurement information is volume information obtained by extracting sound of a predetermined frequency from the sound data acquired by the microphone. The display system described in Appendix 1.

[0073] According to this method, even if ambient noise is included in the sound data acquired from the microphone, it is possible to extract the test sound and accurately measure its volume.

[0074] (Note 3) The aforementioned information processing device displays a volume adjustment selection screen, When a request for manual volume adjustment is received on the aforementioned volume adjustment selection screen, The aforementioned information processing device generates fourth volume setting information based on the user's volume adjustment operation. The information processing device transmits the fourth volume setting information to the display device, The display device updates the volume setting value based on the fourth volume setting information. The display system described in Appendix 1 or 2.

[0075] According to this, users can choose to manually adjust the volume. Specifically, users can easily adjust the volume of the display device to a comfortable listening level by operating the volume adjustment selection screen on their information processing device.

[0076] (Note 4) The information processing device includes an imaging unit, The display device includes a light-emitting section, The information processing device acquires imaging data including the light-emitting unit using the imaging unit, The information processing device transmits fifth volume setting information to the display device based on the depth information data included in the imaging data. The display device generates the first volume setting information based on the fifth volume setting information. The display system described in any one of the appendices 1 to 3.

[0077] According to this, the distance between the display device and the user holding the information processing device is estimated based on the depth information data included in the imaging data, and the volume setting of the display device can be optimized. Furthermore, when performing automatic volume adjustment processing, the sound of the test tone and the acquisition of volume measurement values ​​can be reliably performed.

[0078] (Note 5) A data processing device comprising a microphone and a memory unit transmits a volume adjustment start request to a display device equipped with a speaker. The display device transmits the first volume setting information to the information processing device, The display device causes the speaker to output a test sound, The information processing device acquires volume measurement information based on the sound data acquired by the microphone, The information processing device acquires the second volume setting information stored in the storage unit, If the second volume setting information and the volume measurement information do not match, The information processing device calculates the attenuation rate based on the first volume setting information and the volume measurement information. The information processing device generates third volume setting information based on the second volume setting information and the attenuation rate. The information processing device transmits the third volume setting information to the display device, A volume adjustment method comprising updating the volume setting value based on the third volume setting information using the display device.

[0079] According to this, users can perform the above volume adjustment method simply by running a dedicated app on the information processing device at their viewing position, making it easy to adjust the volume of a display device located at a distance, such as a projector, to a comfortable listening level. Therefore, it is possible to provide a volume adjustment method that allows users to easily adjust the volume to their preference. [Explanation of symbols]

[0080] 5a...Operation icon, 5b...Operation icon, 5c...Operation icon, 6a...Operation icon, 6b...Operation icon, 6c...Operation icon, 7a...Operation icon, 7b...Operation icon, 7c...Operation icon, 7d...Operation icon, 40...Projection device, 41...Control unit, 42...Storage unit, 43...Communication unit, 44...Operation unit, 44a...Indicator, 45...IF unit, 46...Image processing unit, 47...Projection unit, 48...Speaker unit, 49...Light-emitting unit, 51...Operation screen, 52...Operation screen, 53...Guidance screen, 54...Operation screen, 61...Correlation Table, 62...Correlation table, 80...Information processing device, 81...Control unit, 81a...Calculation unit, 82...Storage unit, 82a...First adjustment program, 82b...Second adjustment program, 82c...Third adjustment program, 82d...Fourth adjustment program, 82e...Operation screen data, 82f...Data table, 83...Display unit, 84...Imaging unit, 85...Microphone unit, 86...Speaker unit, 87...First communication unit, 88...Second communication unit, 89...Operation unit, 89b...Operation buttons, 90...System bus, 91...System bus, 100...Display system.

Claims

1. A display device equipped with a speaker, An information processing device comprising a microphone and a memory unit, The information processing device transmits a volume adjustment start request to the display device. The display device transmits the first volume setting information to the information processing device. The display device causes the speaker to output a test sound. The information processing device acquires volume measurement information based on the sound data acquired by the microphone. The information processing device acquires the second volume setting information stored in the storage unit, If the second volume setting information and the volume measurement information do not match, The information processing device calculates the attenuation rate based on the first volume setting information and the volume measurement information. The information processing device generates third volume setting information based on the second volume setting information and the attenuation rate. The information processing device transmits the third volume setting information to the display device. The display device updates the volume setting value based on the third volume setting information. Display system.

2. The aforementioned test sound is a sound of a predetermined frequency, The aforementioned volume measurement information is volume information obtained by extracting sound of a predetermined frequency from the sound data acquired by the microphone. The display system according to claim 1.

3. The aforementioned information processing device displays a volume adjustment selection screen, When a request for manual volume adjustment is received on the aforementioned volume adjustment selection screen, The aforementioned information processing device generates fourth volume setting information based on the user's volume adjustment operation. The information processing device transmits the fourth volume setting information to the display device, The display device updates the volume setting value based on the fourth volume setting information. The display system according to claim 1.

4. The information processing device includes an imaging unit, The display device includes a light-emitting section, The information processing device acquires imaging data including the light-emitting unit using the imaging unit, The information processing device transmits fifth volume setting information to the display device based on the depth information data included in the imaging data. The display device generates the first volume setting information based on the fifth volume setting information. The display system according to claim 1.

5. A data processing device comprising a microphone and a memory unit transmits a volume adjustment start request to a display device equipped with a speaker. The display device transmits the first volume setting information to the information processing device, The display device causes the speaker to output a test sound, The information processing device acquires volume measurement information based on the sound data acquired by the microphone, The information processing device acquires the second volume setting information stored in the storage unit, If the second volume setting information and the volume measurement information do not match, The information processing device calculates the attenuation rate based on the first volume setting information and the volume measurement information. The information processing device generates third volume setting information based on the second volume setting information and the attenuation rate. The information processing device transmits the third volume setting information to the display device, A volume adjustment method comprising updating the volume setting value based on the third volume setting information using the display device.

Images