Sound reproduction systems, display devices

Abstract

Provided is an audio reproduction system with which it is possible to set a sound localization service area in an arbitrary position even when the direction of emission of directional sound cannot be changed. The audio reproduction system according to the present technology is provided with a sound-emitting device for emitting directional sound, and a sound reflector positioned between a viewer and an object being viewed by the viewer, the sound reflector having a sound-reflecting surface reflecting the directional sound emitted by the sound-emitting device.

Description

[Technical field]

[0001] The present technology relates to an audio reproduction system including a sound producing device that emits directional sound and a sound reflector having a sound reflecting surface that reflects the directional sound emitted by the sound producing device, a display device including a self-luminous display unit that displays images, and a calibration method for the audio reproduction system. [Background technology]

[0002] For example, as disclosed in Patent Documents 1 and 2 below, a technique is known in which a directional sound is reflected off a predetermined reflecting surface such as a wall surface in a room or a display surface of a display device, and a subject hears the sound, thereby perceiving (localizing) a sound image in the vicinity of the reflection position of the directional sound. For example, when a directional sound is reflected off the center of the display surface of a display device, a sound image can be localized at the center of the display surface. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3826423 [Patent Document 2] JP 2005-269402 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the sound image localization technology that utilizes reflection from a sound reflecting surface as described above, the reflection position and reflection angle of the directional sound on the reflecting surface can be changed by changing the direction in which the directional sound is emitted or by changing the inclination angle of the reflecting surface, thereby making it possible to adjust the position where the sound image is localized and the sound image localization service area as an area in which sound image localization can be perceived. In this case, for example, when reflecting directional sound on the display surface of the display device exemplified above or on the wall surface of a room, it is difficult to tilt the display surface or wall surface (for example, tilting the display surface leads to deterioration of the display characteristics of the content, such as making it difficult to see the content), so it is considered that the sound image localization service area can be adjusted by adjusting the direction in which the directional sound is emitted.

[0005] However, there may be systems that reproduce directional sound in a manner that does not allow the direction in which the directional sound is emitted to be changed. In such cases, the reflection angle of the directional sound cannot be changed, making it difficult to set the sound image localization service area to a desired position.

[0006] The present invention has been made in consideration of the above circumstances, and aims to provide an audio reproduction system that can set a sound image localization service area at any position even when the direction of emission of directional sound cannot be changed. [Means for solving the problem]

[0007] The sound reproduction system of the present technology includes a sound producing device that emits directional sound, and a sound reflector that is positioned between a viewer and an object to be viewed by the viewer and has a sound reflecting surface that reflects the directional sound emitted by the sound producing device.

[0008] The viewing object means an object that is the object of the viewer's viewing, for example, if the content to be viewed is displayed via a display device, the display unit of the display device corresponds to the viewing object. Alternatively, the content to be viewed may be a performance content such as a play, and in that case, the viewing object corresponds to objects that make up the performance content, such as performers and various stage props placed on the stage. By reflecting directional sound with a sound reflecting surface placed between such a viewing object and the viewer, it becomes possible to arbitrarily determine the reflection angle of the directional sound by setting the inclination angle of the sound reflecting surface.

[0009] In the sound reproduction system according to the present technology described above, the sound generation device may be configured to generate sound by a plane wave. This reduces the attenuation of sound reflected from the sound reflecting surface toward the viewer.

[0010] In the sound reproduction system according to the present technology described above, the sound generation device may have a sound generation section configured with a plane wave speaker. As the plane wave speaker, a dynamic-based plane wave speaker that vibrates a flat panel with a moving coil, or a plane wave speaker that uses an electrostatic diaphragm or a piezoelectric diaphragm can be used.

[0011] In the above-described sound reproduction system according to the present technology, the plane wave speaker may be configured such that the diaphragm is disposed non-parallel to the bottom surface. By arranging the diaphragm non-parallel to the bottom surface, it becomes easier to increase the volume behind the diaphragm, assuming that plane waves are emitted in an oblique direction.

[0012] In the sound reproduction system according to the present technology described above, the sound production device has a speaker array consisting of a plurality of speakers as a sound production section, and can be configured to emit the directional sound from the speaker array by applying a predetermined audio signal processing to the audio signal to be output by the speaker in the speaker array. This makes it possible to adjust the angle of incidence of directional sound on the sound reflecting surface without providing a mechanical angle adjustment mechanism for the speaker.

[0013] In the above-described sound reproducing system according to the present technology, the sound reflecting body may be configured to be light-transmitting. This makes it possible to suppress deterioration in visibility of the object being viewed due to the provision of the sound reflecting body.

[0014] In the above-described sound reproducing system according to the present technology, the sound reflecting surface may be a half mirror. This makes it possible to use the Pepper's Ghost principle to make an image appear on a sound reflecting surface located in front of the object being viewed from the viewer's perspective.

[0015] In the sound reproduction system according to the present technology described above, the sound reflector can be inclined toward the viewer, and the sound generation device can be configured to emit the directional sound from the floor side toward the sound reflecting surface. This makes it possible to tilt the reflected sound from the sound reflecting surface upward from the horizontal direction.

[0016] In the sound reproduction system according to the present technology described above, the sound generation device may be configured to emit the directional sound so as to have a lateral incidence angle with respect to the sound reflecting surface. This makes it possible for a viewer who is in a different lateral position from the position where the directional sound is emitted to perceive the position of the sound source as being near the reflection position of the directional sound.

[0017] In the above-described sound reproducing system according to the present technology, the sound reflecting body may be formed in a plate shape. This makes it possible to form a sound reflecting surface without applying tension to the sound reflecting body as in the case where the sound reflecting body is made in the form of a film.

[0018] In the above-described sound reproducing system according to the present technology, the sound reflecting body may be suspended from the ceiling. The ceiling-suspended support method is suitable for supporting large, heavy panels.

[0019] In the sound reproduction system according to the present technology described above, the sound reflecting surface can be configured to have two sound reflecting surfaces with different inclination directions, and the sound generation device can be configured to emit the directional sound from the ceiling side onto one of the sound reflecting surfaces and from the floor side onto the other sound reflecting surface. This makes it possible for the reflected sounds of directional sounds emitted from the ceiling and floor to cross each other vertically in front of the viewer.

[0020] The above-described sound reproducing system according to the present technology may be configured to include a reflector tilt angle adjustment section that adjusts the tilt angle of the sound reflector. This makes it possible to adjust the angle of incidence and the angle of reflection of directional sound by adjusting the inclination angle of the sound reflector.

[0021] The above-described sound reproduction system according to the present technology may be configured to include a direction adjustment unit that adjusts the sound emission direction of the directional sound. This makes it possible to adjust the angle of incidence and the angle of reflection of directional sound with respect to the sound reflecting surface by adjusting the sound generation direction.

[0022] In the above-described sound reproduction system according to the present technology, the sound production device can be configured such that the sound production unit is composed of a directional speaker, and the direction adjustment unit adjusts the sound production direction of the directional sound by adjusting the angle of the directional speaker. This eliminates the need to perform audio signal processing for adjusting the sound emission direction when adjusting the sound emission direction of directional sound.

[0023] In the sound reproduction system according to the present technology described above, the sound production device can be configured to have a speaker array consisting of a plurality of speakers as a sound production section, and to emit the directional sound from the speaker array by applying a predetermined audio signal processing to the audio signal to be output by the speaker in the speaker array, and the direction adjustment section can be configured to adjust the sound production direction of the directional sound by the audio signal processing. As a result, no mechanical drive noise is generated when adjusting the sound emission direction of the directional sound.

[0024] In the above-described sound reproducing system according to the present technology, the object to be viewed may be a display unit of a self-luminous display device. When displaying the content to be viewed using a display device, it is not possible to adopt the sound image localization technique of placing speakers behind the display surface (screen) as is done when displaying using screen projection. Instead, it is possible to place speakers on the left and right sides of the display surface, but this would result in the display device becoming larger.

[0025] In the sound reproduction system according to the present technology described above, the speaker constituting the sound generation unit of the sound generation device can be configured to be disposed near the floor between the sound reflector and the viewer. An example of a facility for screening viewing content is a theater, and in such a theater there is usually a certain amount of space between the area where the viewing objects are placed and the seating area where the viewers are seated.

[0026] In addition, the display device according to the present technology includes a self-luminous display unit that displays an image, and a sound reflector that is arranged in front of the image display surface of the display unit and has a sound reflecting surface that reflects sound. This positions the sound reflecting surface between the viewer and the object being viewed by the viewer. Therefore, in a sound reproduction system that localizes a sound image by reflecting directional sound on the sound reflecting surface, it is possible to arbitrarily determine the reflection angle of the directional sound by setting the inclination angle of the sound reflecting surface.

[0027] In addition, a calibration method related to the present technology is a calibration method for an audio reproduction system including a sound reproduction device that emits directional sound, a sound reflector positioned between a viewer and an object to be viewed by the viewer and having a sound reflecting surface that reflects the directional sound emitted by the sound reproduction device, and a control unit that controls the angle of incidence of the directional sound onto the sound reflecting surface, the calibration method learning changes in the picked-up signal of the directional sound reflected by the sound reflecting surface in response to changes in the angle of incidence, and adjusting the angle of incidence based on the results of the learning. This makes it possible to adjust the angle of incidence of directional sound so that the sound heard by the listener approaches a target sound, that is, to adjust the sound image localization. [Brief description of the drawings]

[0028] [Figure 1] 1 is a diagram showing an example of the configuration of an audio reproduction system according to an embodiment; [Diagram 2] FIG. 1 is a diagram for explaining an example of the arrangement of a plane wave speaker. [Diagram 3] 1 is a diagram for explaining the relationship between the angle of incidence and the angle of reflection in a sound reflector. FIG. [Figure 4] FIG. 11 is an explanatory diagram of an angle setting method. [Diagram 5] FIG. 13 is an explanatory diagram of the expansion of a sound image localization service area in the height direction. [Figure 6] 11A and 11B are explanatory diagrams of modified examples of the plane wave speaker. [Figure 7] FIG. 11 is an explanatory diagram of a modified example of the plane wave speaker. [Figure 8] 1 shows an example of the structure of a plane wave speaker whose sound emission direction can be mechanically adjusted. [Figure 9] FIG. 1 is an explanatory diagram of an example in which a plane wave is emitted by a speaker array. [Figure 10] FIG. 11 is an explanatory diagram of a first example of a supporting method for a sound reflecting body. [Figure 11] FIG. 11 is an explanatory diagram showing a first example of a method for supporting a sound reflecting body. [Figure 12] FIG. 11 is an explanatory diagram of a second example of a supporting method for a sound reflecting body. [Figure 13] FIG. 11 is an explanatory diagram of a third example of a supporting method for a sound reflecting body. [Figure 14] FIG. 13 is a diagram showing an example of arranging C (center), L (left), and R (right) speakers as an example of stereo reproduction. [Figure 15] FIG. 13 is a diagram showing an example of arranging a plurality of plane wave speakers in a fan shape as an example of stereo reproduction. [Figure 16]FIG. 13 is a diagram showing an example of stereo reproduction in which a plurality of plane wave speakers are arranged in a fan shape. [Figure 17] FIG. 13 is a diagram showing an example in which a plane wave is emitted from a plane wave speaker disposed near a ceiling. [Figure 18] 13A and 13B are diagrams showing an example of a method for supporting a sound reflecting body in a backward tilted state. [Figure 19] This is an explanatory diagram of a technique for emitting plane waves from the floor side to one of two sound reflecting surfaces with different inclination angles, and from the ceiling side to the other. [Figure 20] FIG. 13 is an explanatory diagram of a modified example relating to video display. [Figure 21] 11 is an explanatory diagram of an example in which a sound reflecting material covers only a part of a display surface. FIG. [Figure 22] 13 is an explanatory diagram of another example in which a sound reflecting material covers only a part of a display surface. FIG. [Figure 23] 13 is an explanatory diagram of another example in which a sound reflecting material covers only a part of a display surface. FIG. [Figure 24] 13 is an explanatory diagram of yet another example in which a sound reflecting material covers only a part of a display surface. FIG. [Diagram 25] FIG. 11 is an explanatory diagram of the size conditions of the sound reflecting body for preventing a difference in image quality from being perceived. [Figure 26] FIG. 13 is also an explanatory diagram of size conditions of sound reflecting bodies for preventing image quality differences from being perceived. [Figure 27] 11A and 11B are diagrams for explaining a configuration example for adjusting the inclination angle of a sound reflecting body. [Figure 28] 13A and 13B are diagrams for explaining other configuration examples for adjusting the inclination angle of the sound reflecting body. [Figure 29] FIG. 13 is a diagram for explaining an example of combination with object audio technology. [Diagram 30] FIG. 13 is a diagram for explaining an example of a combination with object audio technology. [Diagram 31] FIG. 11 is an explanatory diagram for adjustment of a sound image localization service area. [Diagram 32]FIG. 1 shows an example of a configuration for learning using a DNN. [Diagram 33] 11 is a flowchart showing an example of a processing procedure during learning. [Diagram 34] FIG. 1 illustrates an example of a configuration for performing calibration using a trained DNN. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] Hereinafter, embodiments of the present technology will be described in the following order with reference to the accompanying drawings. <1. Sound Reproduction System as an Embodiment> <2. Calibration> <3. Modifications> <4. Summary of the embodiment> <5. This Technology>

[0030] <1. Sound Reproduction System as an Embodiment> FIG. 1 shows an example of the configuration of a sound reproduction system 1 according to an embodiment of the present technology. As shown in the figure, the sound reproduction system 1 includes a sound producing device 2 that emits directional sound (sound having directionality), a sound reflector 3 having a sound reflecting surface 31 that reflects the directional sound emitted by the sound producing device 2, and a self-luminous display device 4 that displays images. The audio reproduction system 1 is a system for allowing a viewer 5 to view audiovisual content consisting of video and audio, the display device 4 displays the video that constitutes the audiovisual content, and the audio output device 2 emits the sound that constitutes the audiovisual content. In this example, it is assumed that the sound reproduction system 1 is applied to a theater facility, and a large display device with a screen size of, for example, more than 100 inches is used as the display device 4. In the theater facility, seats 6 are arranged opposite the display surface 41 (image display screen) of the display device 4, and it is assumed that the viewer 5 watches the content while seated in the seat 6 as shown in the figure.

[0031] Hereinafter, the front and rear directions are defined based on the display surface 41 of the image on the display device 4. Specifically, the direction from the back side, which is the surface opposite to the display surface 41 of the display device 4, to the display surface 41 side (i.e., the display output direction of the image) is defined as the front.

[0032] The sound reflector 3 is made of a plate-shaped transparent material (a material having optical transparency). Examples of the transparent material used as the sound reflector 3 include glass and resins such as acrylic and polycarbonate.

[0033] In the sound reproduction system 1 of this example, the sound generation device 2 emits sound by plane waves as directional sound. For this purpose, the sound generation device 2 is provided with a plane wave speaker 21 that emits sound by plane waves. As the plane wave speaker 21, a dynamic-based plane wave speaker that vibrates a flat panel by a moving coil, or a plane wave speaker using an electrostatic diaphragm or a piezoelectric diaphragm can be used.

[0034] In the sound reproducing system 1 of this example, the sound reflector 3 is placed in front of the display device 4 in a state tilted forward from an upright state. Then, a plane wave is emitted from the floor FL side by the plane wave speaker 21 toward the front surface of the sound reflector 3. In this case, the front surface of the sound reflector 3 functions as a sound reflecting surface 31 for the plane wave, and the sound of the plane wave reflected by the sound reflecting surface 31 is emitted toward the viewer 5. In this case, the reflection position of the plane wave in the height direction approximately coincides with the center position of the display surface 41 in the height direction.

[0035] 1 shows an example in which the forward inclination angle of the sound reflector 3 is set to 45 degrees, and plane waves are emitted in the vertical direction. In this case, the image from the display device 4 reaches the viewer 5 straight ahead, so the viewer 5 can sense the sound from the plane wave speaker 21 at the center of the display surface 41 as the "sound source position" (see position Pt in the figure). This is a suitable method for listening to dialogue in a movie, for example. When applied to dialogue, the viewer 5's attention is drawn to the character who is speaking on the image, so the sound image is easily perceived as being localized at the position of the character.

[0036] Here, in order to sufficiently output plane waves down to the low frequency range, it is necessary to drive a considerably large flat panel as the plane wave speaker 21, but in that case, it is unavoidable to increase the size of the plane wave speaker 21. Therefore, a configuration is considered in which mid- to high-frequency sounds above a certain frequency (e.g., 200 Hz) are output from the plane wave speaker 21, and low-frequency sounds below the certain frequency are handled by a subwoofer.

[0037] As shown in the figure, the sound generation device 2 in this example comprises a subwoofer 22 together with a plane wave speaker 21, and further comprises an HPF (high pass filter) 23 that extracts mid- to high-frequency signal components of the audio signal, an LPF (low pass filter) 24 that extracts low-frequency signal components of the audio signal, an amplifier 25 that amplifies the mid- to high-frequency signal components extracted by the HPF 23 to drive the plane wave speaker 21, a delay processing unit 26 that delays the low-frequency signal components extracted by the LPF 24, and an amplifier 27 that amplifies the low-frequency signal components input via the delay processing unit 26 to drive the subwoofer 22.

[0038] Here, even if the low-frequency signal components were output directly from the subwoofer 22, the sound would generally be pulled toward the high-frequency side, with little effect on the localization of the sound, but in this example, the low-frequency signal components are delayed by, for example, several ms in the delay processing unit 26 and output from the subwoofer 22. As a result, the localization is brought closer to the sound waves from the plane wave speaker 21 due to the Haas effect. As shown in FIG. 1, in this example, the subwoofer 22 is disposed on the floor FL, but the position at which the subwoofer 22 is disposed is not limited to the floor FL.

[0039] Fig. 2 is a diagram for explaining an example of the arrangement of the plane wave speaker 21. Fig. 2 shows an image of a bird's-eye view of the theater facility from a position facing the display surface 41 of the display device 4. The figure also shows a schematic representation of the ceiling CL in the theater facility. As shown in the figure, it is possible to arrange a plurality of plane wave speakers 21. In other words, a configuration can be adopted in which plane waves emitted from each of the plurality of plane wave speakers 21 are reflected by the sound reflecting surface 31 and are heard by the listener 5. The plane wave speaker 21 may be positioned near the floor FL between the viewer 5 and the sound reflector 3 as shown in the figure. In theater facilities, a certain amount of space is usually provided between the viewing object (the display screen of the display device 4 in this example) and the seating area where the viewer's seats are located. The above-described arrangement of the plane wave speaker 21 is suitable for theater facilities in which a space is provided between the viewing object and the seating area.

[0040] Furthermore, when the plane wave speaker 21 is placed near the floor FL, it is possible to cover the plane wave speaker 21 with an acoustically transparent sheet as shown as a cover Cv in the figure. For example, an acoustically transparent cloth or fabric is used as the cover Cv. The cover Cv makes it difficult for the viewer 5 to notice the presence of the plane wave speaker 21.

[0041] The plane wave speakers 21 may also be arranged tilted horizontally, like the plane wave speakers 21 arranged at both the left and right ends of the three plane wave speakers 21 shown in the figure. In other words, the plane wave is emitted so as to have a horizontal incident angle with respect to the sound reflecting surface 31.

[0042] This allows the viewer 5, whose lateral position is different from the position where the plane wave is emitted, to perceive the position of the sound source near the reflection position of the plane wave. This makes it easier to expand the area in which sound image localization can be perceived (hereinafter referred to as the "sound image localization service area AL") in the lateral direction. For example, in the illustrated example, each plane wave speaker 21 reflects a plane wave near the central position in the lateral direction of the sound reflecting surface 31. In this case, the viewer 5, who listens to the reflected sound of the plane wave emitted by each plane wave speaker 21, perceives the presence of the sound source near the central position in the lateral direction of the sound reflecting surface 31. If the left and right plane wave speakers 21 are not tilted in the lateral direction, the sound image localization service area AL is approximately the width of three plane wave speakers 21, but by tilting the left and right plane wave speakers 21 in the lateral direction, the width of the sound image localization service area AL can be expanded beyond the width of three plane wave speakers 21. Furthermore, if a plane wave is emitted so as to have a horizontal incidence angle with respect to the sound reflecting surface 31 as described above, it is possible to reduce the number of speakers to be used for expanding the sound image localization service area AL in the horizontal direction.

[0043] Here, in the sound reproduction system 1, since the sound reflector 3 is placed in front of the display device 4, it is conceivable that the viewer 5 may feel uncomfortable about the image quality. In that case, it is also conceivable to provide an image correction processing unit 7a in the image reproduction system 7 that reproduces the image signal to be displayed on the display device 4, and to have the image correction processing unit 7a perform image signal processing for image quality correction.

[0044] FIG. 3 is a diagram for explaining the relationship between the angle of incidence and the angle of reflection in the sound reflector 3. As shown in FIG. In the following description, the subwoofer 22 described in Fig. 1 will be omitted. If the reproducible band of the plane wave speaker 21 is wide, the subwoofer 22 may be unnecessary. In the following description, the configuration of the sound generation device 2 for driving the speaker based on an audio signal (HPF 23, LPF 24, amplifiers 25 and 27, and delay processing unit 26 in FIG. 1) will also be omitted from illustration.

[0045] In FIG. 1, the forward tilt angle of the sound reflecting body 3 is 45 degrees. Here, however, a case where the forward tilt angle is other than 45 degrees will be considered. In theater facilities, a plurality of seats 6 are arranged in a front-to-back and left-to-right direction, and the seats 6 arranged in the front-to-back direction are often arranged so that their height gradually increases from the front to the rear as shown in the figure. In such cases, in consideration of the expansion of the sound image localization service area AL, it is desirable to tilt the reflection direction of the plane wave from the horizontal direction (specifically, tilt it upward). Here, the figure shows a schematic representation of the incident angle (labeled "incident angle" in the figure) and reflection angle (labeled "reflection angle" in the figure) of a plane wave with respect to the sound reflecting surface 31, and in this case, the incident angle and exit angle are each the angle with respect to the perpendicular line V to the sound reflecting surface 31.

[0046] FIG. 4 is an explanatory diagram of a method for setting the angle. As shown in the figure, the inclination angle of the sound reflector 3 with respect to the horizontal direction is the "inclination angle A", the emission angle of the plane wave emitted by the plane wave speaker 21 with respect to the horizontal direction is the "emission angle Q" (here, this coincides with the angle at which the plane wave speaker 21 is tilted), and the inclination angle of the traveling direction of the plane wave reflected by the sound reflecting surface 31 with respect to the horizontal direction is the "traveling angle P". In this case, the relationship between the angles can be expressed as "Q=2A-P-90". Therefore, for example, when the inclination angle A of the sound reflector 3 is 70 degrees and the desired traveling angle P is 15 degrees, the emission angle Q of the plane wave may be set to 35 degrees.

[0047] FIG. 5 is an explanatory diagram of the expansion of the sound image localization service area AL in the height direction. As shown in the figure, a plurality of plane wave speakers 21 are arranged, and each plane wave speaker 21 emits a plane wave toward a different height position on the sound reflecting surface 31. That is, the plane wave from each plane wave speaker 21 is reflected at a different position in the height direction of the sound reflecting surface 31. In the figure, a plurality of plane wave speakers 21 are arranged in the front-to-rear direction, and each plane wave speaker 21 emits a plane wave at the same emission angle Q, so that the plane wave from each plane wave speaker 21 is reflected at a different position in the height direction of the sound reflecting surface 31. This makes it possible to expand the sound image localization service area AL in the height direction.

[0048] 6 and 7 are diagrams for explaining a plane wave speaker 21A as a modified example. As shown in Fig. 7, the plane wave speaker 21A has a structure in which the diaphragm 21a that emits a plane wave is arranged non-parallel to the bottom surface 21b. With this structure, it becomes easier to increase the volume on the back side of the diaphragm 21a when it is assumed that the plane wave is emitted in an oblique direction as shown in Fig. 6. Therefore, it becomes easier to expand the reproducible band to the low frequency side.

[0049] FIG. 8 is a diagram illustrating the structure of a plane wave speaker 21B whose sound generation direction is mechanically adjustable. 8 illustrates a plane wave speaker 21B that includes an angle adjustment unit 21b that supports a speaker body having a diaphragm so that the speaker body can rotate about an axis 21c. Such angle adjustment unit 21b makes it possible to adjust the inclination angle (inclination angle with respect to the horizontal direction) of the speaker body, and thus makes it possible to adjust the sound generation direction.

[0050] In the explanation so far, an example has been given of using a plane wave speaker (i.e., a speaker acting as a surface sound source) configured to be able to output a plane wave by itself as a sound-generating unit that emits a plane wave (directional sound). However, instead of this, as in the sound-generating device 2A shown in FIG. 9, a speaker array 28 in which a plurality of point sound source speakers 28a are arranged one-dimensionally or two-dimensionally can be used to emit a plane wave in a specific direction. As is well known, by using the speaker array 28, it is possible to control the directivity of the sound by delaying the audio signal reproduced by the point sound source speaker 28a and by using a wave field synthesis technique for the sound waves emitted by the point sound source speaker 28a. In other words, it is possible to adjust the emission angle of the plane wave.

[0051] The sound generation device 2A includes a plurality of amplifiers 25 for driving each of the point sound source speakers 28a, and an audio signal processor 29 for performing predetermined audio signal processing on the audio signals to be reproduced by the point sound source speakers 28a and outputting the audio signals to the corresponding amplifiers 25. The audio signal processor 29 performs delay processing for realizing the above-mentioned directivity control or processing for wave field synthesis on the input audio signals.

[0052] Here, when a plane wave is realized using the speaker array 28, there is a risk that the sound emitted by the point sound source speaker 28a may leak to the viewer 5 without passing through the sound reflecting surface 31. In this case, therefore, it is desirable to place an acoustic shield 8 as shown in the figure between the speaker array 28 and the viewer 5. For example, it is desirable to use a member having a sound absorbing function as the acoustic shield 8. In addition, it is desirable to make the acoustic shield 8 curved toward the speaker array 28 side instead of the viewer 5 side as exemplified in the figure, or to place the plate-shaped acoustic shield 8 at an angle toward the speaker array 28 side in order to enhance the effect of preventing sound leakage to the viewer 5.

[0053] Furthermore, when the plane wave is generated using the speaker array 28, there is no need to provide a mechanism for mechanically adjusting the angle of the speaker in order to adjust the sound direction of the plane wave. In this case, the sound direction of the plane wave can be adjusted by the sound signal processing performed by the sound signal processing unit 29 described above.

[0054] 10 and 11 are explanatory diagrams of a first example of a supporting method for the sound reflecting body 3. In FIG. The sound reflector 3 may be supported by being suspended from the ceiling CL as shown in the figure. In this case, the sound reflector 3 has a frame portion 3a made of, for example, metal formed on its edge, and is supported from the ceiling CL at multiple points of the frame portion 3a via support members 9 made of, for example, metal wires that extend downward from the ceiling CL side. In this example, since a large-screen display device is used as the display device 4, the sound reflector 3 is large in size and heavy in weight. The hanging method is suitable for such a case where the sound reflector 3 is large and heavy. Moreover, by providing the frame portion 3a, it is possible to reinforce the sound reflector 3. Furthermore, by using a wire such as a metal wire as the support member 9, it is possible to make the support member 9 less noticeable, thereby improving the sense of immersion in the viewing content.

[0055] Furthermore, the sound reflector 3 may be supported from the side walls of the room, as in the second example shown in Fig. 12 and the third example shown in Fig. 13. In the second example of Fig. 12, the left and right side portions of the frame portion 3a are connected to the left and right side walls via a plurality of support members 9, respectively, and in the third example of Fig. 13, the left and right side portions of the frame portion 3a are directly connected to the left and right side walls, respectively.

[0056] 14 to 16 are diagrams for explaining examples of stereo reproduction. In the explanation so far, it has been assumed that the speaker is used as a substitute for a center speaker, but sound image positioning utilizing reflection from the sound reflector 3 can also be achieved for the L (left) and R (right) speakers. For example, in Fig. 14, the plane wave speaker 21 (hereinafter referred to as "21C") in charge of outputting a center sound indicated by "C" is placed in the center in the horizontal direction, the plane wave speaker 21 (hereinafter referred to as "21R") in charge of outputting an R sound is placed to the right of it (the right side as seen from the viewer 5), and the plane wave speaker 21 (hereinafter referred to as "21L") in charge of outputting an L sound is placed to the left of it. In this case, as shown in the figure, the plane wave output direction of the plane wave speaker 21C is set to the same direction as the front-to-rear direction, the plane wave output direction of the plane wave speaker 21R is inclined to the left with respect to the front-to-rear direction, and the plane wave output direction of the plane wave speaker 21L is inclined to the right with respect to the front-to-rear direction. As a result, for the viewer 5 located near the center in the horizontal direction, the center sound is heard from the center, the R sound is heard from the right side of the center, and the L sound is heard from the left side of the center. Normally, when performing stereo playback, an Lch (channel) speaker and an Rch speaker are placed at the left and right ends of the display device 4, but by adopting this stereo playback method, it becomes possible to omit the speakers that should be placed at the left and right ends of the display device 4, and this space can be used to enlarge the display screen. This contributes to effective use of space and improved design.

[0057] 15 and 16 show an example in which a plurality of plane wave speakers 21 are arranged in a fan shape. 15 and 16, a plurality of plane wave speakers 21 are arranged on an arc having a center behind the sound reflector 3 between the sound reflector 3 and the viewer 5, thereby realizing a fan-shaped arrangement. In this case, the plane wave speaker 21 located in the center of the plane wave speakers 21 arranged in a fan shape is used as the plane wave speaker 21C for center sound output, the plane wave speaker 21 arranged to the right of it is used as the plane wave speaker 21R for R sound output, and the plane wave speaker 21 arranged to the left is used as the plane wave speaker 21L for L sound output. Specifically, nine plane wave speakers 21 are arranged in a fan shape in the figures, but the three plane wave speakers 21 in the center are used as the plane wave speakers 21C, the three plane wave speakers 21 to the right of it are used as the plane wave speakers 21R, and the three plane wave speakers 21 to the left are used as the plane wave speakers 21L. This makes it possible to expand the sound image localization service area AL in the horizontal direction for the center sound, R sound, and L sound more than in the case of FIG.

[0058] In the above explanation, an example has been given in which a plane wave is emitted from the floor FL side to the sound reflecting surface 31. However, as shown in FIG. 17, the plane wave can also be emitted from the ceiling CL side. FIG. 17 shows an example in which a plane wave is emitted from a plane wave speaker 21 disposed near a ceiling CL. When the plane wave is emitted from the ceiling CL side, if the sound reflector 3 is tilted forward, the angle of incidence of the plane wave on the sound reflecting surface 31 needs to be shallow so that the reflected sound from the sound reflecting surface 31 can reach the vicinity of the head of the viewer 5, and therefore the plane wave speaker 21 needs to be placed considerably far away from the sound reflecting body 3. If the plane wave speaker 21 is placed far away from the sound reflecting surface 31, there is a risk that the sound pressure will be significantly attenuated before it reaches the viewer 5. For this reason, as exemplified in Fig. 17, it is desirable to place the sound reflector 3 in this case in a backward tilted state (i.e., tilted toward the display device 4).

[0059] FIG. 18 shows an example of a method for supporting the sound reflecting body 3 in a backward tilted state. As shown in the figure, the sound reflecting body 3 in the backward tilted state may also be supported by a hanging method from the ceiling CL via a plurality of support members 9. Although not shown in the figure, the sound reflecting body 3 in the backward tilted state may also be supported from the side wall as exemplified in Figs. 12 and 13 above.

[0060] Here, a method of emitting a plane wave from the floor FL side and a method of emitting a plane wave from the ceiling CL side can be combined to output a plane wave as shown in FIG. In the sound reproducing system 1 shown in Fig. 19, a sound reflector 3-1 is provided as a sound reflector 3, which is inclined forward to reflect a plane wave emitted from the floor FL side, and a sound reflector 3-2 is provided as a sound reflector 3, which is inclined backward to reflect a plane wave emitted from the ceiling CL side. In this case, the sound reflecting surface 31-1 of the sound reflector 3-1 and the sound reflecting surface 31-2 of the sound reflecting surface 31-2 have different inclination directions. In the figure, a perpendicular line V-1 to the sound reflecting surface 31-1 and a perpendicular line V-2 to the sound reflecting surface 31-2 are shown. FIG. 19 shows an example in which multiple plane wave speakers 21 are provided on both the floor FL side and the ceiling CL side, with the plane wave speaker 21 on the floor FL side emitting a plane wave toward the sound reflecting surface 31-1, and the plane wave speaker 21 on the ceiling CL side emitting a plane wave toward the sound reflecting surface 31-2, but the number of plane wave speakers 21 placed on each of the floor FL side and the ceiling CL side may be single.

[0061] As described above, by configuring the sound reflecting surfaces 31-1 and 31-2 to emit plane waves from the floor FL side and the ceiling CL side, respectively, it becomes possible to make the reflected sounds of the plane waves emitted from the floor FL side and the ceiling CL side cross each other in the vertical direction in front of the viewer 5, as shown in the figure. Therefore, it is possible to reproduce a natural spread of sound from the sound source.

[0062] Furthermore, by adopting a configuration in which sound reflecting surface 31-1 and sound reflecting surface 31-2 emit plane waves from the floor FL side and ceiling CL side, respectively, if there are seats on the first floor and seats on the second floor as seats 6, for example, it is possible to deliver reflected sound from sound reflecting surface 31-1 to the seats on the second floor and reflected sound from sound reflecting surface 31-2 to the seats on the first floor by setting the sound emission direction from the floor FL side and the ceiling CL side, respectively.

[0063] In the configuration shown in FIG. 19, if degradation of image quality occurs, such as the image appearing distorted at the boundary between sound reflectors 3-1 and 3-2, appropriate image signal processing can be applied to correct this.

[0064] FIG. 20 is an explanatory diagram of a modified example relating to video display. In this case, the sound reproducing system 1 is provided with a sub-display device 45 that outputs a sub-video in addition to the display device 4 that outputs a main video. Also, a sound reflector 3A is provided instead of the sound reflector 3. The sound reflector 3A differs from the sound reflector 3 in that it has a sound reflecting surface 31A that is a half mirror. In FIG. 20, the sound reflecting body 3A is arranged to be inclined forward in response to the arrangement of the plane wave speaker 21 on the floor FL side. In this case, the sub-display device 45 is also arranged on the floor FL side, and a sub-image is output to the sound reflecting surface 31A together with the plane wave.

[0065] With this configuration, it is possible to make the sub-image appear on sound reflecting surface 31A, which is located in front of the main image of display device 4 as seen by viewer 5, by using the principle of Pepper's ghost. Therefore, at a specific position on the sound reflecting surface 31A, the viewer 5 can perceive the localization of a sound image and an image that appears to be floating three-dimensionally.

[0066] The technique of making an image appear to float based on the Pepper's Ghost principle using sound reflecting surface 31A as described above can also be applied to the case where a plane wave is emitted from the ceiling CL side as shown in Figure 17, or to the case where a plane wave is emitted from both the floor FL side and the ceiling CL side as shown in Figure 19.

[0067] In the explanation so far, it has been assumed that the sound reflecting body 3 covers the entire display surface 41 of the display device 4. However, as illustrated in Figures 21 to 24, the sound reflecting body 3 may cover only a portion of the display surface 41. Figures 21 and 22 show configurations corresponding to the case where a plane wave is emitted from the floor FL side, with Figure 21 showing a case where the sound reflector 3 is positioned away from the display surface 41 and forward, and Figure 22 showing a case where the sound reflector 3 is abutted against the display surface 41 at its lower end. Figures 23 and 24 show configurations corresponding to the case where a plane wave is emitted from the ceiling CL side, with Figure 23 showing a case where the sound reflecting body 3 is positioned away from the display surface 41 and forward, and Figure 24 showing a case where the sound reflecting body 3 abuts against the display surface 41 at its upper end.

[0068] Here, there is a risk that the viewer 5 may perceive a difference in image quality between areas covered by the sound reflector 3 and areas not covered by it, but in order to prevent such a difference in image quality from being perceived, it is not essential that the sound reflector 3 covers the entire display surface 41. 25 and 26 are explanatory diagrams regarding size conditions of the sound reflecting body 3 for preventing a difference in image quality, with Fig. 25 illustrating an example of the arrangement of the sound reflecting body 3 when a plane wave is emitted from the floor FL side, and Fig. 26 illustrating an example of the arrangement of the sound reflecting body 3 when a plane wave is emitted from the ceiling CL side. In order to prevent a difference in image quality, a straight line UE connecting the viewpoint position Pe of the viewer 5 and the upper end position Pu of the display surface 41, and a straight line DE connecting the viewpoint position Pe and the lower end position Pd of the display surface 41 are used as references, and it is sufficient that the upper end position of the sound reflecting body 3 is located above the straight line UE and the lower end position of the sound reflecting body 3 is located below the straight line DE.

[0069] Here, in the previous Figure 8, we have mentioned that the sound projection direction of the plane wave is adjusted by adjusting the inclination angle of the plane wave speaker 21 using the angle adjustment unit 21b, and further mentioned that the sound projection direction of the plane wave is adjusted by audio signal processing when the speaker array 28 is used, but the adjustment of the reflection angle of the plane wave on the sound reflecting surface 31 can also be performed by adjusting the inclination angle of the sound reflector 3.

[0070] Fig. 27 is a diagram for explaining a configuration example for adjusting the tilt angle of the sound reflecting body 3. Fig. 27 illustrates a configuration example for a display device 4A that is integrally provided with an angle adjustment unit 4b that adjusts the tilt angle of the sound reflecting body 3, as a configuration example corresponding to a case where a plane wave is emitted from the floor FL side by a plane wave speaker 21. The display device 4A has a main body 4a having a display surface 41, and an angle adjustment unit 4b formed integrally with the main body 4a. The angle adjustment unit 4b rotates the sound reflector 3 around an axis 4c supporting the lower end of the sound reflector 3. This makes it possible to adjust the tilt angle of the sound reflector 3 in the forward tilt direction. Also, the sound reflector 3 can be brought into a state parallel to the display surface 41 (i.e., an upright state: tilt angle = 0 degrees). Here, bringing the sound reflector 3 into a state parallel to the display surface 41 can be considered as bringing the sound reflector 3 into a stored state, so to speak, so that it does not protrude toward the viewer 5. In this case, the sound reflecting body 3 is integrated with the main body 4a via the angle adjustment portion 4b, and constitutes a part of the display device 4A.

[0071] FIG. 28 is a diagram for explaining another configuration example for adjusting the inclination angle of the sound reflector 3, and specifically shows an example configuration of a display device 4B that corresponds to the case where a plane wave is emitted from the ceiling CL side by a plane wave speaker 21. 27 is that the shaft 4c supports the upper end of the sound reflecting body 3. This allows the angle of inclination of the sound reflecting body 3 in the backward inclination direction to be adjusted by the angle adjustment part 4b in this case, and allows the sound reflecting body 3 to be in a state parallel to the display surface 41 (stored state).

[0072] By making the inclination angle of the sound reflector 3 adjustable, it is possible to adjust the sound image localization service area AL without adjusting the sound emission direction of the directional sound on the sound emission device 2 side. In addition, by making the inclination angle of the sound reflector 3 adjustable, it is possible to store the sound reflector 3 in a stored state parallel to the display surface 41, for example, when the sound reproduction system 1 is not in use.

[0073] In the above, the angle adjustment unit 4b is formed integrally with the display device 4, but the angle adjustment unit 4b may be formed separately from the display device 4. In this case, the sound reflector 3 is naturally formed separately from the display device 4.

[0074] Here, when performing plane wave output using the speaker array 28 as exemplified above in FIG. 9, it is possible to realize moving sound image localization by combining it with object audio technology. For example, as shown in Fig. 29 and Fig. 30, a plurality of point sound source speakers 28a constituting a speaker array 28 are arranged in the horizontal direction. In this case, by performing the above-mentioned audio signal processing such as delay for controlling the direction of the plane wave based on the object audio technology, it is possible to perceive the movement of the sound image in the horizontal direction as shown in Fig. 30. Note that when a plurality of point sound source speakers 28a are arranged in the vertical direction, it is also possible to perceive the movement of the sound image in the vertical direction by combining with the object audio technology.

[0075] <2. Calibration> For example, in an environment such as a theater facility where a relatively large number of seats 6 are provided and a large number of viewers 5 can watch the target content, it is possible to adjust the position and size of the sound image localization service area AL depending on, for example, the number of viewers 5 present. FIG. 31 is an explanatory diagram for adjusting such a sound image localization service area AL. FIG. 31A illustrates an example in which the sound image localization service area AL is defined in the center of a seating area where multiple seats 6 are arranged, while FIG. 31B illustrates an example in which the sound image localization service area AL is defined in a part of the front side of the seating area (front side here means the side closer to the object being viewed). For example, if viewers 5 are concentrated near the center of the seating area, the sound image localization service area may be adjusted to the sound image localization service area AL shown in FIG. 31A, and if viewers 5 are concentrated near the front of the seating area, the sound image localization service area may be adjusted to the sound image localization service area AL shown in FIG. 31B.

[0076] The sound image localization service area AL can be adjusted by adjusting the angle of incidence of the plane wave with respect to the sound reflecting surface 31. That is, this can be done by adjusting the inclination angle of the sound reflector 3 or the direction in which the plane wave is emitted with respect to the sound reflector 3, specifically, by adjusting the speaker inclination angle when the plane wave speaker 21B is used, or by adjusting the audio signal processing when the speaker array 28 is used.

[0077] The adjustment of the incident angle of the plane wave with respect to the sound reflecting surface 31 can be performed as a pre-adjustment (calibration) before the viewer 5 actually views the audiovisual content. Such a calibration of the incident angle of the plane wave can be performed in order to adjust the position and size of the sound image localization service area AL as exemplified in FIG.

[0078] Calibration can also be performed so that the localization of the sound image is as clear as possible in a predetermined target area such as a seat. In this case, the adjustment of the incident angle of the plane wave on the sound reflecting surface 31 as calibration can also be performed based on the result of learning the change in the pickup signal of the reflected sound on the sound reflecting surface 31 with respect to the change in the incident angle. More specifically, it is considered to train the artificial intelligence using the change in the incident angle of the plane wave on the sound reflecting surface 31, and to input the pickup signal of the reflected sound on the sound reflecting surface 31 with respect to the incident angle to the learned model of the artificial intelligence generated after training, and perform the adjustment based on the result of estimation.

[0079] 32 to 34 are diagrams for explaining an apparatus and method for generating an artificial intelligence model that performs calibration by inputting data such as an acoustic signal and angle information and training it, and an apparatus and method for performing calibration using the generated trained artificial intelligence model. More specifically, a DNN (Deep Neural Network) is used as the artificial intelligence, a trained model is generated by inputting data into the DNN and training it, and calibration is performed using the generated model. In addition to DNNs, examples of artificial intelligence that can be used include machine learning. The neural networks that make up DNNs can have a variety of algorithms, forms, and structures, such as CNNs (Convolutional Neural Networks), RNNs (Recurrent Neural Networks), Generative Adversarial Networks, Variational Auto-encoders, Self-Organizing Feature Maps, and Spiking Neural Networks (SNNs), and by combining these in any way, it is possible to generate a trained model with the desired input-output relationship.

[0080] FIG. 32 shows an example of a configuration for learning using a DNN. In the figure, the seating section 60 means an area where a plurality of seats 6 are arranged two-dimensionally as viewed from above (area where a plurality of viewers 5 are expected to view) in a room for viewing, such as a theater facility, where the display device 4 is arranged (hereinafter simply referred to as the room). In a theater facility, the seats 6 may be arranged at an angle as shown in FIG. 31, or may be arranged on the same plane as an orchestra pit or arena seats in a concert hall. As shown in the figure, a sound reflecting body 3 is arranged in front of the display device 4, and a speaker group 20 is arranged between the sound reflecting body 3 and the seating section 60. In this example, the speaker group 20 is composed of a plurality of plane wave speakers 21B (having an angle adjustment section 21b). Hereinafter, the number of the plane wave speakers 21B in the speaker group 20 is represented as "N". In this case, a plurality of microphones (microphones) M are arranged at predetermined positions in the room. Specifically, in this example, the microphones M are arranged around the seat 60. Hereinafter, the number of microphones M will be expressed as M pieces. In this case, a camera C is disposed inside (or outside) the room. The camera C captures an image in the direction of the seat 60 from the display device 4 side.

[0081] The speaker angle control circuit 51 controls the inclination angle of each of the plane wave speakers 21B that constitute the speaker group 20. Note that the speaker group 20 can also be configured to emit a plurality of plane waves using a speaker array 28 as shown in Fig. 9, and in that case, the speaker angle control circuit 51 is configured to control the angle of incidence of the plane waves on the sound reflecting surface 31 by audio signal processing.

[0082] The acoustic signal processing circuit 52 receives the sound signals picked up by the microphones M and performs predetermined acoustic processing on each of the sound signals. For example, the acoustic processing in this case is processing for generating acoustic characteristic data.

[0083] The sound generation circuit 53 is provided for each speaker (that is, N speakers), and causes each of the plane wave speakers 21B in the speaker group 20 to reproduce an arbitrary sound. The sound generation circuit 53 is also capable of generating acoustic characteristic data for the sound source.

[0084] Here, during training, the input to DNN54 is as follows: A collection of the results of acoustic processing of the input from each microphone M by the acoustic signal processing circuit 52 (such as acoustic characteristic data). Acoustic characteristic data of the sound source generated by the sound generation circuit 53. This can be said as the ideal sound that should be heard at each seat 6. In the figure, a set of angles (initial angles: angles before calibration) of each speaker in the speaker group 20 is shown as angle information Ii of each speaker. Image captured by camera C. Note that input of image captured by camera C may be optional.

[0085] In addition, the output (learning target) of the DNN 54 is a set of angles (adjusted angles: angles after calibration) of each speaker in the speaker group 20.

[0086] The loss function 55 may include software or a circuit that controls backpropagation for training the DNN 54. The backpropagation control software or circuit may be separately equipped in association with the loss function 55. The input of the loss function 55 is as follows. A collection of the results of acoustic processing of the input from each microphone M by the acoustic signal processing circuit 52 (such as acoustic characteristic data). Acoustic characteristic data of the sound source generated by the sound generation circuit 53 (ideal sound to be heard at each seat 6). A set of angles (initial angles: angles before calibration) of each speaker in the speaker group 20 as speaker angle information Ii. A set of angles (adjusted angles: angles after calibration) of each speaker in the speaker group 20, shown as angle information Ia of each speaker in the figure.

[0087] During learning, in addition to the microphone M as a fixed microphone, a microphone can also be set at each seat 6 for measurement.

[0088] FIG. 33 is a flowchart showing an example of a processing procedure during learning. First, the sound generation circuit 53 generates ideal sound from the speaker (step S101). Next, the current input is made to the DNN 54, and the angle of each speaker as the initial angle is input as an output to the loss function 55 (step S102).

[0089] Next, the loss function 55 compares the input from each microphone M with the ideal sound (step S103), and determines whether the difference between the input from the microphone M and the ideal sound is within an acceptable range (step S104). If the difference between the input from each microphone M and the ideal sound is not within the acceptable range, the speaker angle control circuit 51 changes the angle of each speaker by a predetermined value (step S105). This process is repeated until the overall difference between the input from each microphone M and the ideal sound is within the acceptable range. In other words, it is repeated until the value of the loss function is minimized with respect to the microphone input.

[0090] On the other hand, if the difference between the input from microphone M and the ideal acoustics is within an acceptable range, the loss function 55 is trained by modifying the weights of the neural network by backpropagation so that the set of speaker angles as the initial angles and the set of adjusted speaker angles are minimized.

[0091] During learning, the process shown in FIG. 33 is repeatedly executed for the necessary learning samples.

[0092] FIG. 34 illustrates an example configuration for performing calibration using a trained DNN54 (i.e., a trained artificial intelligence model). As can be seen by referring to Figure 34, during calibration, the same input is made to the trained DNN 54 as before training, and the speaker angle control circuit 51 adjusts the angle of each speaker in the speaker group 20 based on the output from the DNN 54.

[0093] By adopting the above-mentioned calibration method using DNN54 (i.e., a trained artificial intelligence model), it is possible to generate an algorithm (i.e., a trained artificial intelligence model) for calibration that can handle all cases by learning only some of all possible cases (e.g., speaker placement positions, audience 5 inclusion, etc.). Therefore, it is possible to reduce the workload required to achieve appropriate calibration.

[0094] <3. Modifications> The embodiment is not limited to the specific examples given above, and various modifications are possible. For example, in the above example, the content to be viewed by the viewer 5 is displayed via the display device 4, but the content to be viewed by the viewer 5 can also be a performance content such as a play. In this case, the sound reflecting body 3 may be placed between an object related to the performance and the viewer 5, for example, between the viewer 5 and a stage where a play is performed.

[0095] Moreover, the sound reflecting body 3 may have the sound reflecting surface 31 made of an anti-reflection film or may have an anti-reflection coating applied to the sound reflecting surface 31. This can prevent the viewer 5 from seeing the image with less visibility.

[0096] In addition, the sound reflector 3 is assumed to be a plate-shaped body so that the sound reflecting surface 31 is a flat surface, but the sound reflecting surface 31 may have a surface shape other than a flat surface. For example, the sound reflecting surface 31 may have at least a partially curved surface.

[0097] Moreover, a film-like (sheet-like) member can be used instead of a plate-like member for the sound reflecting body 3. By applying tension to the film-like sound reflecting body 3 to give it tension, it can function as a sound reflecting member. In this case, it is conceivable that the film-like sound reflector 3 can be stored using a winding mechanism or folded like bellows.

[0098] Moreover, the sound reflecting body 3 may be configured so that the length of the sound reflecting surface 31 is adjustable. In particular, when the sound reflecting body 3 is in the form of a film, the length of the sound reflecting body 3 can be adjusted by adjusting the amount of winding.

[0099] Also, considering that dust may adhere to the sound reflecting body 3, it is possible to provide a dust removing function. Specifically, it is possible to remove dust by outputting a specific sound (preferably a low-frequency sound) from the plane wave speaker 21 or the speaker array 28 to vibrate the sound reflecting body 3.

[0100] Alternatively, in order to prevent dust from entering the rear surface of the sound reflecting surface 31, the space between the display device 4 and the sound reflector 3 may be covered with a covering material such as a sheet.

[0101] <4. Summary of the embodiment> As described above, the sound reproduction system (1) as an embodiment comprises a sound generating device (2 or 2A) that emits directional sound, and a sound reflecting body (3 or 3A) that is positioned between a viewer and an object to be viewed by the viewer and has a sound reflecting surface (31 or 31A) that reflects the directional sound emitted by the sound generating device.

[0102] The viewing object means an object that is the object of the viewer's viewing, for example, if the content to be viewed is displayed via a display device, the display unit of the display device corresponds to the viewing object. Alternatively, the content to be viewed may be a performance content such as a play, and in that case, the viewing object corresponds to objects that make up the performance content, such as performers and various stage props placed on the stage. By reflecting directional sound with a sound reflecting surface placed between such a viewing object and the viewer, it becomes possible to arbitrarily determine the reflection angle of the directional sound by setting the inclination angle of the sound reflecting surface. Therefore, even if the sound output direction of directional sound cannot be changed, it is possible to provide a sound reproducing system capable of setting a sound image localization service area at an arbitrary position.

[0103] In the sound reproducing system according to the embodiment, the sound generating device generates sound by a plane wave. This reduces the attenuation of sound reflected from the sound reflecting surface toward the viewer. Therefore, the sense of localization of the sound image can be improved.

[0104] Furthermore, in the sound reproduction system according to the embodiment, the sound generation device has a sound generation section that is configured with a plane wave speaker (21, 21A, or 21B). As the plane wave speaker, a dynamic-based plane wave speaker that vibrates a flat panel with a moving coil, or a plane wave speaker that uses an electrostatic diaphragm or a piezoelectric diaphragm can be used. There is no longer a need to perform audio signal processing to generate plane waves, as is the case when a pseudo-plane wave is generated by delaying an audio signal using a speaker array, and the processing burden for sound reproduction can be reduced.

[0105] Furthermore, in the sound reproducing system according to the embodiment, the diaphragm of the plane wave speaker (21A) is disposed non-parallel to the bottom surface. By arranging the diaphragm non-parallel to the bottom surface, it becomes easier to increase the volume behind the diaphragm, assuming that plane waves are emitted in an oblique direction. Therefore, it becomes easier to expand the reproducible band toward the lower frequency side.

[0106] In addition, in an embodiment of the sound reproduction system, the sound production device (same as 2A) has a speaker array (same as 28) consisting of multiple speakers as a sound production section, and emits directional sound from the speaker array by applying a predetermined audio signal processing to the audio signal to be output by the speakers in the speaker array. This makes it possible to adjust the angle of incidence of directional sound on the sound reflecting surface without providing a mechanical angle adjustment mechanism for the speaker. By eliminating the need for a speaker angle adjustment mechanism, there is no need to consider mechanical durability or the burden of maintenance, which makes it possible to reduce the maintenance costs of the audio reproduction system.

[0107] Furthermore, in the sound reproducing system according to the embodiment, the sound reflecting body is optically transparent. This makes it possible to suppress deterioration in visibility of the object being viewed due to the provision of the sound reflecting body. This makes it possible to improve the sense of immersion in the viewing content.

[0108] Furthermore, in the sound reproducing system according to the embodiment, the sound reflecting surface is a half mirror. This makes it possible to use the Pepper's Ghost principle to make an image appear on a sound reflecting surface located in front of the object being viewed from the viewer's perspective. Therefore, at a specific position on the sound reflecting surface, the viewer can perceive the localization of a sound image and an image that appears to be floating three-dimensionally.

[0109] In the sound reproducing system according to the embodiment, the sound reflecting body is inclined toward the viewer, and the sound generating device emits directional sound from the floor side toward the sound reflecting surface. This makes it possible to tilt the reflected sound from the sound reflecting surface upward from the horizontal direction. Therefore, when a seating arrangement is adopted in which the seat positions of the audience become higher as the audience moves away from the viewing object, it becomes easier to enlarge the sound image localization service area.

[0110] Furthermore, in the sound reproducing system according to the embodiment, the sound generating device emits directional sound having a lateral incidence angle with respect to the sound reflecting surface. This makes it possible for a viewer who is in a different lateral position from the position where the directional sound is emitted to perceive the position of the sound source as being near the reflection position of the directional sound. This makes it easier to expand the sound image localization service area in the lateral direction, and also makes it possible to reduce the number of speakers that need to be used to expand the sound image localization service area in the lateral direction.

[0111] Furthermore, in the sound reproducing system according to the embodiment, the sound reflector is formed in a plate shape. This makes it possible to form a sound reflecting surface without applying tension to the sound reflecting body as in the case where the sound reflecting body is made in the form of a film. Therefore, the sound reflecting surface can be easily formed.

[0112] In the sound reproducing system according to the embodiment, the sound reflecting body is suspended from the ceiling. The ceiling-suspended support method is suitable for supporting large, heavy panels. Therefore, this is suitable for cases where the area of ​​the sound reflecting body is to be increased, such as when it is desired to cover the entire front side of a large display device.

[0113] Furthermore, in the embodiment of the sound reproduction system, there are two sound reflecting surfaces (31-1 and 31-2) having different inclination directions, and the sound generating device emits directional sound from the ceiling side onto one sound reflecting surface and from the floor side onto the other sound reflecting surface. This makes it possible for the reflected sounds of directional sounds emitted from the ceiling and floor to cross each other vertically in front of the viewer. Therefore, it is possible to reproduce the natural sound spread from the sound source.

[0114] Furthermore, the sound reproducing system according to the embodiment includes a reflector tilt angle adjustment section (angle adjustment section 4b) that adjusts the tilt angle of the sound reflector. This makes it possible to adjust the angle of incidence and the angle of reflection of directional sound by adjusting the inclination angle of the sound reflector. Therefore, the sound image localization service area can be adjusted without adjusting the sound emission direction of the directional sound on the sound emission device side. Furthermore, by providing a reflector inclination angle adjustment section, when the sound reproduction system is not in use, the inclination angle of the sound reflector can be set to approximately 0 degrees, for example, to achieve a stored state in which the sound reflector does not protrude toward the viewer.

[0115] Moreover, the sound reproducing system according to the embodiment includes a direction adjustment unit (angle adjustment unit 21b or audio signal processing unit 29) that adjusts the sound output direction of the directional sound. This makes it possible to adjust the angle of incidence and the angle of reflection of directional sound with respect to the sound reflecting surface by adjusting the sound generation direction. Therefore, the sound image localization service area can be adjusted.

[0116] Furthermore, in the sound reproduction system according to the embodiment, the sound generation device has a sound generation unit that is configured from a directional speaker, and the direction adjustment unit adjusts the sound generation direction of the directional sound by adjusting the angle of the directional speaker. This eliminates the need to perform audio signal processing for adjusting the sound emission direction when adjusting the sound emission direction of directional sound. Therefore, the processing load during sound reproduction can be reduced.

[0117] Furthermore, in an embodiment of the sound reproduction system, the sound production device has a speaker array consisting of multiple speakers as a sound production section, and emits directional sound from the speaker array by applying a predetermined audio signal processing to the audio signal to be output by the speakers in the speaker array, and the direction adjustment section adjusts the sound production direction of the directional sound by audio signal processing. As a result, no mechanical drive noise is generated when adjusting the sound emission direction of the directional sound. Therefore, it is possible to improve quietness when adjusting the sound image localization service area.

[0118] In the sound reproducing system according to the embodiment, the viewing object is the display unit of a self-luminous display device (4, 4A or 4B). When displaying the content to be viewed using a display device, it is not possible to adopt the sound image localization technique of placing speakers behind the display surface (screen) as is done when displaying using screen projection. Instead, it is possible to place speakers on the left and right sides of the display surface, but this would result in the display device becoming larger. When the viewing object is the display unit of a self-luminous display device, applying a sound image localization method that reflects directional sound on a sound reflector can prevent the display device from becoming larger. In addition, the space that would normally be used for speakers can be used to enlarge the display screen, contributing to effective use of space and improved design.

[0119] Furthermore, in the sound reproducing system according to the embodiment, the speaker constituting the sound generating section of the sound generating device is disposed near the floor between the sound reflecting body and the audience. An example of a facility for screening viewing content is a theater, and in such a theater there is usually a certain amount of space between the area where the viewing objects are placed and the seating area where the viewers are seated. The above-mentioned speaker arrangement is suitable for theater facilities where there is a space between the viewing object and the seating area.

[0120] In addition, the display device (4A or 4B) as an embodiment includes a self-luminous display unit (main body 4a) that displays an image, and a sound reflector (3 or 3A) that is arranged in front of the image display surface (41) of the display unit and has a sound reflecting surface (31 or 31A) that reflects sound.

[0121] This positions the sound reflecting surface between the viewer and the object being viewed by the viewer. Therefore, in a sound reproduction system that localizes a sound image by reflecting directional sound on the sound reflecting surface, it is possible to arbitrarily determine the reflection angle of the directional sound by setting the inclination angle of the sound reflecting surface. Therefore, even if the sound output direction of directional sound cannot be changed, it is possible to provide a sound reproducing system capable of setting a sound image localization service area at an arbitrary position.

[0122] In addition, a calibration method as an embodiment is a calibration method for an audio reproduction system that includes a sound reproduction device that emits directional sound, a sound reflector that is positioned between a viewer and an object to be viewed by the viewer and has a sound reflecting surface that reflects the directional sound emitted by the sound reproduction device, and a control unit that controls the angle of incidence of the directional sound onto the sound reflecting surface, in which the calibration method learns changes in the picked-up signal of the directional sound reflected by the sound reflecting surface in response to changes in the angle of incidence, and adjusts the angle of incidence based on the results of the learning.

[0123] This makes it possible to adjust the angle of incidence of directional sound so that the sound heard by the listener approaches a target sound, that is, to adjust the sound image localization. Therefore, it is possible to improve the clarity of the sound image perceived by the viewer, and to improve the sense of immersion in the content being viewed.

[0124] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0125] <5. This Technology> The present technology can also be configured as follows. (1) A sound generating device that generates directional sound; a sound reflector positioned between a viewer and an object to be viewed by the viewer and having a sound reflecting surface that reflects the directional sound emitted by the sound generating device; Sound reproduction system. (2) The sound generating device generates sound by plane waves. The sound reproduction system according to (1) above. (3) The sound generating device has a sound generating unit constituted by a plane wave speaker. The sound reproduction system according to (2) above. (4) The plane wave speaker has a diaphragm arranged non-parallel to the bottom surface. The sound reproduction system according to (3) above. (5) The sound generating device has a speaker array consisting of a plurality of speakers as a sound generating unit, and generates the directional sound from the speaker array by performing a predetermined sound signal processing on the sound signal to be output by the speaker in the speaker array. The sound reproduction system according to (1) or (2) above. (6) The sound reflector has light transparency. An audio reproduction system according to any one of (1) to (5) above. (7) The sound reflecting surface is a half mirror. The sound reproduction system according to (6) above. (8) The sound reflector is inclined toward the listener. The sound generating device emits the directional sound from a floor side toward the sound reflecting surface. An audio reproduction system according to any one of (1) to (7) above. (9) The sound generating device emits the directional sound so as to have a horizontal incidence angle with respect to the sound reflecting surface. An audio reproduction system according to any one of (1) to (8) above. (10) The sound reflector is formed in a plate shape. An audio reproduction system according to any one of (1) to (9) above. (11) The sound reflector is suspended from the ceiling. The sound reproduction system according to (10) above. (12) The sound reflecting surface has two sound reflecting surfaces with different inclination directions, The sound generating device emits the directional sound from a ceiling side to one of the sound reflecting surfaces and from a floor side to the other sound reflecting surface. An audio reproduction system according to any one of (1) to (11) above. (13) A reflector inclination angle adjustment unit for adjusting the inclination angle of the sound reflector is provided. An audio reproduction system according to any one of (1) to (12) above. (14) A direction adjustment unit that adjusts the direction of the directional sound is provided. An audio reproduction system according to any one of (1) to (13) above. (15) The sound generating device has a sound generating unit formed of a directional speaker, The direction adjustment unit adjusts the sound output direction of the directional sound by adjusting an angle of the directional speaker. The sound reproduction system according to (14) above. (16) the sound generation device has a speaker array consisting of a plurality of speakers as a sound generation unit, and generates the directional sound from the speaker array by performing a predetermined sound signal processing on a sound signal to be output by the speaker in the speaker array; The direction adjustment unit adjusts the sound output direction of the directional sound by the audio signal processing. The sound reproduction system according to (14) above. (17) The viewing object is a display unit of a self-luminous display device. An audio reproduction system according to any one of (1) to (16) above. (18) A speaker constituting a sound generating unit of the sound generating device is disposed near the floor between the sound reflector and the audience. An audio reproduction system according to any one of (1) to (17) above. (19) A self-luminous display unit for displaying an image; a sound reflector disposed in front of the image display surface of the display unit and having a sound reflecting surface that reflects sound; Display device. (20) A calibration method for a sound reproduction system including: a sound generator that generates directional sound; a sound reflector that is positioned between a viewer and an object to be listened to by the viewer and has a sound reflecting surface that reflects the directional sound generated by the sound generator; and a control unit that controls an incident angle of the directional sound to the sound reflecting surface, the method comprising: A change in the pickup signal of the directional sound reflected on the sound reflecting surface in response to a change in the incident angle is learned, and the incident angle is adjusted based on the result of the learning. Calibration method. [Explanation of symbols]

[0126] 1. Sound reproduction system 2,2A Sound Producing Device 21, 21A, 21B Plane wave speaker 21a diaphragm 21b Angle adjustment section 21c Shaft 22 Subwoofer 23 HPF (High Pass Filter) 24 LPF (Low Pass Filter) 28 Speaker Array 28a Point source speaker 29 Audio signal processing section 3, 3A sound reflector 31, 31A Sound reflective surface 3a Frame section 4,4A,4B Display device 41 Display surface 4a Main body 4b Angle adjustment section 4c Shaft 5. Viewers 6 seats 7 Video playback system 7a Image correction processing section 8 Acoustic shield 9 Supporting member Pt position CL Ceiling FL floor Cv Cover AL Sound image localization service area

Claims

1. A sound generating device that generates directional sound; a sound reflector positioned between a viewer and an object to be viewed by the viewer and having a sound reflecting surface that reflects the directional sound emitted by the sound generating device; The sound reflector has two sound reflecting surfaces with different inclination directions as the sound reflecting surfaces, The sound generating device emits the directional sound from a ceiling side to one of the sound reflecting surfaces and from a floor side to the other sound reflecting surface. Sound reproduction system.

2. The sound generating device generates sound by plane waves.

2. The sound reproduction system according to claim 1.

3. The sound generating device has a sound generating unit constituted by a plane wave speaker.

3. The sound reproduction system according to claim 2.

4. The plane wave speaker has a diaphragm arranged non-parallel to the bottom surface.

4. The sound reproduction system according to claim 3.

5. The sound generating device has a speaker array consisting of a plurality of speakers as a sound generating unit, and generates the directional sound from the speaker array by performing a predetermined sound signal processing on the sound signal to be output by the speaker in the speaker array.

2. The sound reproduction system according to claim 1.

6. The sound reflector has light transmissivity.

2. The sound reproduction system according to claim 1.

7. The sound reflecting surface is a half mirror.

7. A sound reproduction system according to claim 6.

8. The sound reflector has a forward-inclined sound reflecting surface that is inclined toward the viewer, The sound generating device emits the directional sound from a floor side toward the forward-tilting sound reflecting surface.

2. The sound reproduction system according to claim 1.

9. The sound generating device emits the directional sound so as to have a horizontal incidence angle with respect to the sound reflecting surface.

2. The sound reproduction system according to claim 1.

10. The sound reflector is formed in a plate shape.

2. The sound reproduction system according to claim 1.

11. The sound reflector is suspended from the ceiling.

11. A sound reproduction system according to claim 10.

12. A reflector inclination angle adjustment unit for adjusting the inclination angle of the sound reflector is provided.

2. The sound reproduction system according to claim 1.

13. A direction adjustment unit that adjusts the direction of the directional sound is provided.

2. The sound reproduction system according to claim 1.

14. The sound generating device has a sound generating unit formed of a directional speaker, The direction adjustment unit adjusts the sound output direction of the directional sound by adjusting an angle of the directional speaker.

14. A sound reproduction system according to claim 13.

15. the sound generation device has a speaker array consisting of a plurality of speakers as a sound generation unit, and generates the directional sound from the speaker array by performing a predetermined sound signal processing on a sound signal to be output by the speaker in the speaker array; The direction adjustment unit adjusts the sound output direction of the directional sound by the audio signal processing.

14. A sound reproduction system according to claim 13.

16. The viewing object is a display unit of a self-luminous display device.

2. The sound reproduction system according to claim 1.

17. A speaker constituting a sound generating unit of the sound generating device is disposed near the floor between the sound reflector and the audience.

2. The sound reproduction system according to claim 1.

18. A self-luminous display unit for displaying an image; a sound reflector disposed in front of a display surface of the image on the display unit and having a sound reflecting surface that reflects sound; The sound reflector has two sound reflecting surfaces with different inclination directions. Display device.

Images