Audiovisual presentation device and signal processing device

The audiovisual presentation device addresses sound localization issues on LED displays by using a laminated structure with sound guide tubes and microspeakers, enhancing sound-image synchronization and flexibility, and maintaining image quality.

JP7764860B2Active Publication Date: 2025-11-06SONY GROUP CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022561819
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-13
Filing Date
2021-10-29
Publication Date
2025-11-06
Estimated Expiration
2041-10-29

Smart Images

  • Figure 0007764860000001
    Figure 0007764860000001
  • Figure 0007764860000002
    Figure 0007764860000002
  • Figure 0007764860000003
    Figure 0007764860000003
Patent Text Reader

Abstract

The present disclosure relates to a video / audio presentation apparatus and a signal processing apparatus for making it possible to achieve sound localization on a video displayed on a screen having higher image quality. In the video / audio presentation apparatus, a plurality of fine openings provided in a substrate of a display unit in which light-emitting elements for displaying video are arranged in an array, and an air chamber of a speaker unit for outputting audio in accordance with an audio signal are connected by means of a plurality of sound guiding tubes. The video / audio presentation apparatus is further provided with a plurality of open / close mechanisms for individually opening and closing the sound guiding tubes, and a plurality of microspeakers provided in an array on the substrate of the display unit to output a range of audio higher than that of a speaker of the speaker unit. The present technology is applicable to high-quality LED displays, for example.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an audio-visual presentation device and a signal processing device, and more particularly to an audio-visual presentation device and a signal processing device that are capable of localizing a sound image in an image displayed on a higher quality screen. [Background technology]

[0002] In general, in video content that accompanies audio and video, localizing sound images in relation to the video displayed on the screen is considered to play an important role in creating an immersive experience. Conventionally, localizing sound images in relation to the video displayed on the screen has been achieved by placing a sound source such as a speaker system in relation to the screen.

[0003] For example, in movie theaters, sound images are localized in the images displayed on the screen using an acoustically transparent screen. That is, a sound source such as a speaker system is placed behind the screen (the opposite side to the surface onto which the image is projected by the projector), and sound output from the sound source is transmitted through the screen to reach the audience, thereby localizing the sound image in the image.

[0004] For example, Patent Document 1 discloses a sound-transmitting display device in which a multi-matrix speaker is placed on the rear surface of a display panel and multiple holes are distributed at a uniform density on the display panel to allow the sound emitted from the multi-matrix speaker to pass through. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Special Publication No. 2012-529073 Summary of the Invention [Problem to be solved by the invention]

[0006] Recently, LED (Light Emitting Diode) displays have been developed as high-quality image display devices featuring high brightness, high dynamic range, high definition, etc. Unlike the above-mentioned movie theater screens, LED displays are not acoustically transparent, so it has been difficult to achieve sound localization in the image.

[0007] Furthermore, the method of projecting images onto an acoustically transparent screen using a projector can be subject to restrictions on the installation environment, and for example, image quality can be degraded in bright environments such as outdoors due to the influence of light sources. Therefore, there is a need to avoid such degradation in image quality and achieve sound image localization in images displayed on high-quality image presentation devices such as LED displays.

[0008] The present disclosure has been made in consideration of such circumstances, and makes it possible to localize a sound image in a video displayed on a screen with higher image quality. [Means for solving the problem]

[0009] The audiovisual presentation device according to the first aspect of the present disclosure includes an array of light emitting elements for displaying an image. a light emitting substrate to be disposed, a circuit board on which a drive circuit for driving the light emission of the light emitting substrate is provided, and a transparent substrate provided to protect the light emitting substrate are laminated together, and a wiring is formed so as to penetrate from the circuit board through the light emitting substrate to the transparent substrate. The display device includes a display unit having a plurality of microscopic holes provided in the display unit, a speaker unit having a speaker that outputs sound to the air chamber according to an acoustic signal, and a plurality of sound guide tubes that connect the air chamber and the plurality of microscopic holes.

[0010] In a first aspect of the present disclosure, light emitting elements for displaying an image are arranged in an array. A display unit is configured by laminating a light emitting substrate, a circuit board on which a drive circuit for driving the light emission of the light emitting substrate is provided, and a transparent substrate provided to protect the light emitting substrate. A plurality of fine holes provided in the speaker unit are connected by a plurality of sound guide tubes to an air chamber of the speaker unit that outputs sound in accordance with an acoustic signal.

[0011] The audiovisual presentation device according to a second aspect of the present disclosure includes an array of light emitting elements for displaying an image. a light emitting substrate to be disposed, a circuit board on which a drive circuit for driving the light emission of the light emitting substrate is provided, and a transparent substrate provided to protect the light emitting substrate are laminated together, and a wiring is formed so as to penetrate from the circuit board through the light emitting substrate to the transparent substrate.a display unit having a plurality of micropores formed therein; a speaker unit having a speaker that outputs sound to an air chamber according to an acoustic signal; a plurality of sound guide tubes connecting the air chamber and the plurality of micropores; a plurality of opening and closing mechanisms that individually open and close the plurality of sound guide tubes; and a plurality of microspeakers that are arranged in an array on a substrate of the display unit and output sound in a higher frequency range than the speaker of the speaker unit. The signal processing device for an audiovisual presentation device includes an opening and closing control unit that controls opening and closing by the plurality of opening and closing mechanisms, a selector unit that controls selection from the plurality of microspeakers, and a controller that controls the opening and closing control unit and the selector unit depending on the position of a sound source on an image displayed on the display unit.

[0012] In a second aspect of the present disclosure, light emitting elements for displaying images are arranged in an array. a display unit including a light-emitting substrate, a circuit board on which a drive circuit for driving the light emission of the light-emitting substrate is provided, and a transparent substrate for protecting the light-emitting substrate; The audiovisual presentation device is configured such that a plurality of micropores provided in the display unit are connected by a plurality of sound conduits to an air chamber of a speaker unit that outputs sound in accordance with an acoustic signal. The device is also equipped with a plurality of opening and closing mechanisms that individually open and close the plurality of sound conduits, and a plurality of microspeakers that are arranged in an array on the substrate of the display unit and output sound in a higher frequency range than the speakers of the speaker unit. An opening and closing control unit controls the opening and closing of the plurality of opening and closing mechanisms, and a selector unit controls selection of the plurality of microspeakers, depending on the position of the sound source on the image displayed on the display unit. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating a configuration example of a first embodiment of a video and audio presentation device to which the present technology is applied. [Figure 2] FIG. 10 is a diagram illustrating a configuration example of a second embodiment of a video and audio presentation device. [Figure 3] FIG. 10 is a diagram illustrating a configuration example of a third embodiment of a video and audio presentation device. [Figure 4] FIG. 10 is a diagram illustrating a configuration example of a fourth embodiment of a video and audio presentation device. [Figure 5]FIG. 10 is a diagram illustrating a configuration example of a fifth embodiment of a video and audio presentation device. [Figure 6] FIG. 1 is a block diagram showing an example of the configuration of a signal processing device. [Figure 7] 10A and 10B are diagrams illustrating an example of a control method for a micro speaker. [Figure 8] FIG. 10 is a diagram illustrating a configuration example of a sixth embodiment of a video and audio presentation device. [Figure 9] FIG. 13 is a diagram illustrating a modified example of the sixth embodiment of the audio-visual presentation device. [Figure 10] FIG. 13 is a diagram illustrating a configuration example of a seventh embodiment of a video and audio presentation device. [Figure 11] FIG. 13 is a diagram illustrating a configuration example of an eighth embodiment of a video and audio presentation device. [Figure 12] FIG. 13 is a diagram illustrating a configuration example of a ninth embodiment of a video and audio presentation device. [Figure 13] FIG. 13 is a diagram illustrating a modified example of the audio-visual presentation device according to the ninth embodiment. [Figure 14] FIG. 1 is a diagram illustrating a perspective configuration example of a video and audio presentation system. [Figure 15] FIG. 1 is a diagram illustrating an example of a cross-sectional configuration of a video and audio presentation system. [Figure 16] 1 is a block diagram illustrating an example of the configuration of a video and audio presentation system. [Figure 17] FIG. 2 is a block diagram illustrating an example configuration of an audio decoder. [Figure 18] 1 is a block diagram illustrating an example of the configuration of an embodiment of a computer to which the present technology is applied. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.

[0015] <First Configuration Example of Audio-Visual Presentation Device> FIG. 1 is a diagram showing a configuration example of a first embodiment of a video and audio presentation device to which the present technology is applied.

[0016] 1, audiovisual presentation device 11 is configured by connecting display unit 12 and speaker unit 13 by a plurality of sound guide tubes 14. In the example shown in FIG. 1, display unit 12 and speaker unit 13 are connected by three sound guide tubes 14-1 to 14-3, but a configuration using a greater number of sound guide tubes 14 may be used depending on the size of audiovisual presentation device 11.

[0017] The display unit 12 is configured by laminating a circuit board 21, a light-emitting board 22, and a transparent board 23, and has a plurality of micropores 24 formed therein.

[0018] The circuit board 21 is provided with a drive circuit that drives the light emission of the light-emitting board 22. The light-emitting board 22 has a plurality of light-emitting elements, such as LEDs, arranged in an array, that emit red, green, and blue light, and images are displayed when these LEDs emit light. The transparent board 23 is provided to protect the light-emitting board 22 and is made of, for example, low-reflection film glass.

[0019] The microscopic holes 24 are provided in accordance with the number of sound conduits 14, and sound that is conducted by the sound conduits 14 is radiated from the microscopic holes 24. In the example shown in Fig. 1, there are three microscopic holes 24-1 to 24-3 provided, with sound conduit 14-1 connected to microscopic hole 24-1, sound conduit 14-2 connected to microscopic hole 24-2, and sound conduit 14-3 connected to microscopic hole 24-3.

[0020] The speaker unit 13 is configured to include a speaker body 31, an enclosure 32, and an air chamber 33. The speaker body 31 is housed in the enclosure 32, and outputs sound in accordance with an acoustic signal to the air chamber 33 to which the sound conduits 14-1 to 14-3 are connected.

[0021] The sound guide tubes 14-1 to 14-3 conduct the sound output from the speaker unit 13 to the micro holes 24-1 to 24-3, respectively.

[0022] The audiovisual presentation device 11 is configured in this manner, and sound output from the speaker unit 13 is conducted through the sound conduits 14-1 to 14-3 and output from the micropores 24-1 to 24-3 of the display unit 12. Therefore, the audiovisual presentation device 11 can output sound from the screen of the display unit 12, making it possible to localize a sound image in the image displayed on the screen.

[0023] In the audiovisual presentation device 11, the speaker unit 13 can be installed at a location away from the display unit 12 by using the sound guide tubes 14-1 to 14-3. This makes it easier to use a large display unit 12, for example, and is advantageous in that it allows for high sound pressure and low-frequency reproduction.

[0024] In the audiovisual presentation device 11, the speaker units 13 have air chambers 33, so that the speaker bodies 31 are arranged in the individual air chambers 33, and the air chambers 33 are connected to the microholes 24-1 to 24-3 formed in the display unit 12 by the individual sound guide tubes 14-1 to 14-3. This allows, for example, sound corresponding to an image displayed by the LEDs of the light-emitting substrate 22 around the microholes 24-1 to 24-3 to be output from the speaker bodies 31 arranged in the air chambers 33 connected to the individual microholes 24-1 to 24-3, thereby improving localization. Therefore, the audiovisual presentation device 11 can improve the effect of localizing the sound source to the image displayed on the display unit 12 (i.e., the effect of matching the image and sound).

[0025] <Second Configuration Example of Audio-Visual Presentation Device> FIG. 2 is a diagram showing a configuration example of a second embodiment of a video and audio presentation device to which the present technology is applied.

[0026] In the audio-visual presentation device 11A shown in Fig. 2, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11A has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12 and a speaker unit 13. On the other hand, the audio-visual presentation device 11A has sound conduits 14A-1 to 14A-3 that connect the display unit 12 and the speaker unit 13, which are different in configuration from those in the audio-visual presentation device 11 in Fig. 1.

[0027] The sound conduits 14A-1 to 14A-3 are formed so that the path lengths (lengths that serve as paths for conducting sound) from the air chamber 33 of the speaker unit 13 to the micropores 24-1 to 24-3 are approximately the same. In other words, the sound conduits 14A-1 to 14A-3 are configured so that the sounds output from the speaker unit 13 are radiated from the micropores 24-1 to 24-3 with approximately the same time delays.

[0028] The audiovisual presentation device 11A configured in this manner can avoid (or minimize) the occurrence of a time difference in the sounds radiated from the micropores 24-1 to 24-3 by aligning the path lengths of the sound conduits 14A-1 to 14A-3. This allows the audiovisual presentation device 11A to reduce the discomfort (for example, sound variation) that occurs when a time difference occurs in the sounds radiated from the micropores 24-1 to 24-3.

[0029] <Third Configuration Example of Audio-Visual Presentation Device> FIG. 3 is a diagram illustrating a configuration example of a third embodiment of a video and audio presentation device to which the present technology is applied.

[0030] In the audio-visual presentation device 11B shown in Fig. 3, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11B has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12 and a speaker unit 13. On the other hand, the audio-visual presentation device 11B has sound conduits 14B-1 to 14B-3 that connect the display unit 12 and the speaker unit 13, which are different in configuration from those in the audio-visual presentation device 11 in Fig. 1.

[0031] The sound conduits 14B-1 to 14B-3 are formed in a so-called horn shape, with the inner diameter increasing from the air chamber 33 of the speaker unit 13 toward the micropores 24-1 to 24-3.

[0032] The audiovisual presentation device 11B configured in this manner can control the directivity and efficiency of the sounds radiated from the micropores 24-1 to 24-3 by forming the sound conduits 14B-1 to 14B-3 in a horn shape.

[0033] <Fourth Configuration Example of Audio-Visual Presentation Device> FIG. 4 is a diagram illustrating a configuration example of a fourth embodiment of a video and audio presentation device to which the present technology is applied.

[0034] In the audio-visual presentation device 11C shown in Fig. 4, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed descriptions thereof will be omitted. That is, the audio-visual presentation device 11C has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12, a speaker unit 13, and sound conduits 14-1 to 14-3. On the other hand, the audio-visual presentation device 11C has a different configuration from the audio-visual presentation device 11 in Fig. 1 in that it includes opening / closing mechanisms 41-1 to 41-3 for the sound conduits 14-1 to 14-3.

[0035] The opening and closing mechanisms 41-1 to 41-3 are provided for the sound conduits 14-1 to 14-3, respectively, so as to open and close the sound conduits 14-1 to 14-3 individually. That is, the opening and closing mechanism 41-1 opens and closes the sound conduit 14-1, the opening and closing mechanism 41-2 opens and closes the sound conduit 14-2, and the opening and closing mechanism 41-3 opens and closes the sound conduit 14-3.

[0036] The audiovisual presentation device 11C configured in this manner can dynamically and independently control the opening and closing of the sound conduits 14-1 to 14-3 using the opening and closing mechanisms 41-1 to 41-3, thereby arbitrarily selecting micropores 24-1 to 24-3 that serve as sound source positions on the display unit 12. This allows, for example, the audiovisual presentation device 11C to realize multiple sound source positions with one speaker unit 13. Furthermore, by dynamically and independently controlling the opening and closing of the sound conduits 14-1 to 14-3 using the opening and closing mechanisms 41-1 to 41-3, the locality of the sound output can be further improved.

[0037] <Fifth Configuration Example of Audio-Visual Presentation Device> FIG. 5 is a diagram illustrating a configuration example of a fifth embodiment of a video and audio presentation device to which the present technology is applied.

[0038] In the audio-visual presentation device 11D shown in Fig. 5, components common to those in the audio-visual presentation device 11 of Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11D has a common configuration with the audio-visual presentation device 11 of Fig. 1 in that it includes a speaker unit 13 and sound conduits 14-1 to 14-3. On the other hand, the audio-visual presentation device 11D is provided with opening and closing mechanisms 41-1 to 41-3 like the audio-visual presentation device 11C of Fig. 4, and the structure of the display unit 12D is different from that of the audio-visual presentation device 11 of Fig. 1.

[0039] The display unit 12D is configured such that microspeakers 51-1 to 51-3 that output higher-frequency sounds than the speaker body 31 of the speaker unit 13 are provided on the circuit board 21 for each of the micropores 24-1 to 24-3. For example, each microspeaker 51 is configured to have a speaker element 52 that outputs sound and an individual, independent enclosure 53, and is small in size with a diameter of 1 mm or less.

[0040] The audiovisual presentation device 11D configured in this manner can reproduce low-midrange sounds using the speaker unit 13 and high-range sounds using the microspeakers 51-1 to 51-3. For example, due to the structure in which sound is conducted by the sound conduits 14-1 to 14-3, high-range sounds tend to be attenuated in the sound output from the speaker unit 13. Therefore, the audiovisual presentation device 11D can improve the frequency characteristics in the high range by using the microspeakers 51-1 to 51-3 in combination.

[0041] Furthermore, in the display unit 12D, the microspeakers 51-1 to 51-3 are configured to reproduce only high frequencies, which allows the diaphragm area to be reduced, thereby minimizing the area occupied by the microspeakers 51-1 to 51-3 in the display unit 12D.

[0042] FIG. 6 is a block diagram showing an example of the configuration of a signal processing device that performs signal processing on the audio-visual presentation device 11D.

[0043] As shown in FIG. 6, the signal processing device 101 includes a low-pass filter 102, an amplifier 103, a high-pass filter 104, a delay element 105, an amplifier 106, a selector 107, a controller 108, and a switching control device 109.

[0044] An audio signal (Audio Input) input to the signal processing device 101 is supplied to a low-pass filter 102 and a high-pass filter 104. The low-pass filter 102 passes only the low frequency band of the audio signal and supplies it to an amplifier 103. The audio signal amplified by the amplifier 103 is supplied to the speaker main body 31.

[0045] The high-pass filter 104 passes only the high frequency band of the acoustic signal and supplies it to the delay element 105, and after a predetermined delay time has elapsed in the delay element 105, the acoustic signal is supplied to the amplifier 106. The acoustic signal amplified by the amplifier 106 is supplied to the selector 107, and the acoustic signal is supplied to a microspeaker 51 selected from the N microspeakers 51-1 to 51-N under the control of the controller 108.

[0046] Controller 108 controls opening / closing control device 109 and selector 107 so that sound is output from the position of the sound source according to the position of the sound source on the image displayed on the display unit. Opening / closing control device 109 controls opening / closing by multiple opening / closing mechanisms 41-1 to 41-N.

[0047] The signal processing device 101 is configured in this manner, and can use the multiple opening and closing mechanisms 41-1 to 41-N to select the micropore 24 that will output sound from among the multiple micropores 24-1 to 24-N. At this time, if the sound conduits 14-1 to 14-N are different lengths, the timing of sound production can be aligned by adding an appropriate delay to each. Furthermore, the signal processing device 101 can use the selector 107 to select the microspeakers 51-1 to 51-N that will play sound in conjunction with the micropores 24-1 to 24-N that are opened and closed by the opening and closing mechanisms 41-1 to 41-N.

[0048] An example of a method for controlling the microspeaker 51 will be described with reference to FIG.

[0049] For example, since there is a limit to the maximum sound pressure per micro-speaker 51, a control method can be adopted in which the number of micro-speakers 51 to be driven is dynamically changed depending on the desired sound pressure for the entire audiovisual presentation device 11D.

[0050] Here, let us assume that one of the multiple microspeakers 51 arranged in an array is operating abnormally, such as producing excessive output or generating abnormal heat, as shown in the upper part of Figure 7. In this case, it is assumed that the other microspeakers 51 are operating normally.

[0051] In such a case, as shown in the lower part of Figure 7, the output of the malfunctioning microspeaker 51 is suppressed, and the output of the surrounding microspeakers 51 is increased to compensate for the suppressed output of the malfunctioning microspeaker 51. The other microspeakers 51 are operated normally.

[0052] By using such a control method, the audiovisual presentation device 11D can reproduce normal sounds as a whole even if an abnormal operation occurs in the microspeaker 51.

[0053] <Sixth Configuration Example of Audio-Visual Presentation Device> FIG. 8 is a diagram illustrating a configuration example of a sixth embodiment of a video and audio presentation device to which the present technology is applied.

[0054] In the audio-visual presentation device 11E shown in Fig. 8, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11E has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12 and sound conduits 14-1 to 14-3. On the other hand, the audio-visual presentation device 11D has a different configuration from that of the audio-visual presentation device 11 in Fig. 1 in the structure of the speaker unit 13E.

[0055] The speaker unit 13E is configured to include a plurality of speaker bodies 31E. In the example shown in Fig. 8, the speaker unit 13E is configured such that three speaker bodies 31E-1 to 31E-3 are housed in a common enclosure 32E and each speaker body outputs a sound according to an acoustic signal to a single air chamber 33E. The speaker bodies 31E-1 to 31E-3 may have characteristics for outputting sounds in overlapping frequency bands, or may have characteristics for outputting sounds in different frequency bands. The speaker bodies 31E-1 to 31E-3 may also be used as backups in case one of them breaks down.

[0056] 9 shows a modified example of the configuration example of the audio-visual presentation device according to the sixth embodiment. That is, in an audio-visual presentation device 11F shown in FIG. 9, a speaker unit 13F is configured such that three speaker bodies 31F-1 to 31F-3 are housed in individual enclosures 32F-1 to 32F-3, respectively.

[0057] Alternatively, a configuration may be adopted in which a single sound conduit 14 is provided so that one air chamber 33 is connected to only one micropore 24.

[0058] <Seventh Configuration Example of Audio-Visual Presentation Device> FIG. 10 is a diagram illustrating a configuration example of a seventh embodiment of a video and audio presentation device to which the present technology is applied.

[0059] In the audio-visual presentation device 11G shown in Fig. 10, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11G has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12, a speaker unit 13, and sound conduits 14-1 to 14-3. On the other hand, the audio-visual presentation device 11G has a different configuration from the audio-visual presentation device 11 in Fig. 1 in that it includes a speaker unit 13G that is separate from the speaker unit 13.

[0060] Speaker unit 13G is provided independently of speaker unit 13, and is configured such that air chamber 33G of speaker unit 13G is connected midway through sound conduit 14-1 by sound conduit 14-4. Note that similarly, a configuration may be adopted in which an independent speaker unit 13 (not shown) is connected to a desired sound conduit 14, such as providing an independent speaker unit 13 that is connected midway through sound conduit 14-2 or 14-3.

[0061] In the audio-visual presentation device 11G configured in this manner, the speaker body 31 of the speaker unit 13 and the speaker body 31G of the speaker unit 13G may be configured to output sounds in different frequency bands.

[0062] <Eighth Configuration Example of Audio-Visual Presentation Device> FIG. 11 is a diagram illustrating a configuration example of an eighth embodiment of a video and audio presentation device to which the present technology is applied.

[0063] In the audio-visual presentation device 11H shown in Fig. 11, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed descriptions thereof will be omitted. That is, the audio-visual presentation device 11H has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a display unit 12, a speaker unit 13, and sound conduits 14-1 to 14-3. On the other hand, the audio-visual presentation device 11H has a different configuration from the audio-visual presentation device 11 in Fig. 1 in that the display unit 12 and sound conduits 14-1 to 14-3 are separate from the speaker unit 13.

[0064] That is, the audiovisual presentation device 11H is configured so that the air chamber 33 of the speaker unit 13 and the air chamber 33H to which the sound conduits 14-1 to 14-3 are connected are connected by a flexible sound conduit 61. Note that if the display unit 12 and the sound conduits 14-1 to 14-3 are configured separately from the speaker unit 13, the connection therebetween is not limited to the sound conduit 61, and any connection configuration can be adopted.

[0065] The audiovisual presentation device 11H configured in this way allows for greater freedom in the placement of the speaker units 13.

[0066] <Ninth Configuration Example of Audio-Visual Presentation Device> FIG. 12 is a diagram illustrating a configuration example of a ninth embodiment of a video and audio presentation device to which the present technology is applied.

[0067] In the audio-visual presentation device 11J shown in Fig. 12, components common to those in the audio-visual presentation device 11 in Fig. 1 are assigned the same reference numerals, and detailed description thereof will be omitted. That is, the audio-visual presentation device 11J has a common configuration with the audio-visual presentation device 11 in Fig. 1 in that it includes a speaker unit 13. On the other hand, the audio-visual presentation device 11J includes a plurality of display units 12J, and sound conduits 14J-1 to 14J-8 connecting these display units 12J and the speaker units 13 have a different configuration from those in the audio-visual presentation device 11 in Fig. 1.

[0068] 12, the audiovisual presentation device 11J is configured to include two display units 12J-1 and 12J-2. The micropores 24-1 to 24-3 of the display unit 12J-1 are connected to the air chamber 33J-1 by sound conduits 14J-1 to 14J-3. Similarly, the micropores 24-4 to 24-6 of the display unit 12J-2 are connected to the air chamber 33J-2 by sound conduits 14J-4 to 14J-6. The air chamber 33 of the speaker unit 13 is connected to the air chamber 33J-1 by sound conduit 14J-7 and to the air chamber 33J-2 by sound conduit 14J-8.

[0069] In this way, the audiovisual presentation device 11J is configured so that one speaker unit 13 is connected to two display units 12J-1 and 12J-2. Note that the configuration may also be such that the speaker unit 13 is connected to two or more display units 12J.

[0070] FIG. 13 shows a modified example of the configuration example of the audio-visual presentation device according to the ninth embodiment.

[0071] 13, the micropores 24-1 to 24-3 of the display unit 12K-1 are connected to the air chamber 33K-1 of the speaker unit 13K-1 by sound conduits 14K-1 to 14K-3. Similarly, the micropores 24-4 to 24-6 of the display unit 12K-2 are connected to the air chamber 33K-2 of the speaker unit 13K-2 by sound conduits 14K-4 to 14K-6. The air chamber 33 of the speaker unit 13K-2 is connected to the air chamber 33K-1 by sound conduit 14K-7 and to the air chamber 33K-2 by sound conduit 14K-8.

[0072] In this way, the audio-visual presentation device 11K is configured such that one speaker unit 13 is connected to two display units 12K-1 and 12K-2, and the display units 12K-1 and 12K-2 are equipped with speaker units 13K-1 and 13K-2, respectively. In this case, the speaker body 31 of the speaker unit 13, the speaker body 31K-1 of the speaker unit 13K-1, and the speaker body 31K-2 of the speaker unit 13K-2 may be configured to output sounds in different frequency bands.

[0073] <Configuration example of audiovisual presentation system> 14 to 17, a video and audio presentation system including a plurality of video and audio presentation devices 11 will be described.

[0074] FIG. 14 is a diagram illustrating an example of a perspective configuration of the audio-visual presentation system 72, and FIG. 15 is a diagram illustrating an example of a cross-sectional configuration of the audio-visual presentation system 72. As shown in FIG.

[0075] For example, a set of multiple audio and visual presentation devices 11 constitutes a cabinet 71, and a set of multiple cabinets 71 constitutes an audio and visual presentation system 72. In the example shown in Fig. 14, four audio and visual presentation devices 11 are arranged in a 2x2 tile pattern to constitute the cabinet 71, and 24 cabinets 71 are arranged in a 6x4 tile pattern to constitute the audio and visual presentation system 72.

[0076] In the audiovisual presentation system 72 configured in this manner, by controlling the sound output according to the sound source on the image displayed on each audiovisual presentation device 11, it is possible to, for example, localize the sound image in accordance with the movement of the sound source.

[0077] As shown in FIG. 16, the audio and video presentation system 72 further includes a demultiplexer 111, a video decoder 112, an audio decoder 113, a video output signal line 114, and an audio output signal line 115.

[0078] For example, content data input to the audio and video presentation system 72 is input to a demultiplexer 111 and separated into video data and audio data. The video data is input to a video decoder 112 and decoded, and then supplied to the audio and video presentation devices 11 arranged in tiles via a video output signal line 114. The audio data is input to an audio decoder 113 and decoded, and then supplied to the audio and video presentation devices 11 arranged in tiles via an audio output signal line 115.

[0079] FIG. 17 is a block diagram showing an example of the configuration of the audio decoder 113.

[0080] The audio decoder 113 is configured to include a channel audio renderer 121 , an object audio renderer 122 , and a scene-based audio renderer 123 .

[0081] That is, the audio decoder 113 is configured to be able to handle object audio data using the object audio renderer 122. For example, in object audio, an audio signal and meta information are provided, and the object audio renderer 122 uses this information to generate an audio signal.

[0082] The audio decoder 113 is configured to be able to handle scene-based audio data using the scene-based audio renderer 123. In scene-based audio, one or more levels of Ambisonics audio data are provided, and the scene-based audio renderer 123 uses this information to generate an audio signal.

[0083] The audiovisual presentation system 72 is configured in this way, and by generating audio signals based on object audio data or scene-based audio data, it is possible to localize a sound image in accordance with the movement of a sound source on a video screen. In Figure 16, the sound source on the video screen is represented by the shape of a hand. If the sound source moves as indicated by the dashed arrow, the audiovisual presentation system 72 can move the sound image localization to match the movement.

[0084] <Example of computer configuration> Next, the above-described series of processes (signal processing method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

[0085] FIG. 18 is a block diagram showing an example of the configuration of an embodiment of a computer in which a program for executing the above-described series of processes is installed.

[0086] The program can be pre-recorded on the hard disk 205 or ROM 203 as a recording medium built into the computer.

[0087] Alternatively, the program can be stored (recorded) on a removable recording medium 211 driven by the drive 209. Such a removable recording medium 211 can be provided as a so-called package software. Here, examples of the removable recording medium 211 include a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor memory.

[0088] The program can be installed into the computer from the removable recording medium 211 as described above, or can be downloaded to the computer via a communication network or a broadcasting network and installed into the built-in hard disk 205. That is, the program can be transferred to the computer wirelessly from a download site via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet.

[0089] The computer includes a built-in CPU (Central Processing Unit) 202 , to which an input / output interface 210 is connected via a bus 201 .

[0090] When a user inputs a command via input / output interface 210 by operating input unit 207, CPU 202 executes a program stored in ROM (Read Only Memory) 203 in accordance with the command. Alternatively, CPU 202 loads a program stored on hard disk 205 into RAM (Random Access Memory) 204 and executes it.

[0091] As a result, the CPU 202 performs processing according to the flowchart described above or processing performed by the configuration of the block diagram described above. Then, the CPU 202 outputs the processing results from the output unit 206 via the input / output interface 210, transmits them from the communication unit 208, or records them on the hard disk 205, as necessary.

[0092] The input unit 207 is made up of a keyboard, a mouse, a microphone, etc. The output unit 206 is made up of an LCD (Liquid Crystal Display), a speaker, etc.

[0093] In this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing that is executed in parallel or individually (for example, parallel processing or processing by objects).

[0094] The program may be processed by a single computer (processor), or may be distributed among multiple computers. Furthermore, the program may be transferred to and executed on a remote computer.

[0095] Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0096] Also, for example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

[0097] Furthermore, for example, this technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by multiple devices via a network.

[0098] Furthermore, for example, the above-described program can be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.

[0099] Also, for example, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices. Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as one step.

[0100] In addition, the processing of the steps of a program executed by a computer may be executed in chronological order according to the order described in this specification, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

[0101] It should be noted that the present technologies described in this specification can be implemented independently and singly, unless a contradiction arises. Of course, any two or more of the present technologies can also be implemented in combination. For example, part or all of the present technologies described in any embodiment can be implemented in combination with part or all of the present technologies described in other embodiments. Furthermore, part or all of any of the present technologies described above can also be implemented in combination with other technologies not described above.

[0102] <Configuration combination example> The present technology can also be configured as follows. (1) a display unit having light-emitting elements arranged in an array on a substrate for displaying an image, and a plurality of microholes formed in the substrate; a speaker unit having a speaker that outputs sound to an air chamber according to an acoustic signal; a plurality of sound guide tubes connecting the air chamber and the plurality of micropores; An audio-visual presentation device comprising: (2) The plurality of sound guide tubes are configured to have substantially the same path length from the air chamber of the speaker unit to the plurality of microholes. The audiovisual presentation device according to (1) above. (3) The plurality of sound guide tubes are configured so that their inner diameters increase from the air chamber of the speaker unit toward the plurality of microholes. The audiovisual presentation device according to (1) or (2) above. (4) A plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits The audiovisual presentation device according to any one of (1) to (3) above, further comprising: (5) a plurality of micro-speakers arranged in an array on the substrate of the display unit, the micro-speakers outputting sounds in a higher frequency range than the speakers of the speaker unit; The audiovisual presentation device according to any one of (1) to (4) above, further comprising: (6) a plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits; a plurality of micro-speakers arranged in an array on the substrate of the display unit and outputting sounds in a higher frequency range than the speakers of the speaker unit; Furthermore, The opening and closing of the plurality of opening and closing mechanisms and the selection of the plurality of micro-speakers are controlled according to the position of the sound source on the image displayed on the display unit. The audiovisual presentation device according to any one of (1) to (5) above. (7) The speaker unit has a plurality of speakers, which are housed in the same or separate enclosures. The audiovisual presentation device according to any one of (1) to (6) above. (8) further comprising a second speaker unit separate from the speaker unit; The air chamber of the second speaker unit is connected to a desired sound guide tube. The audiovisual presentation device according to any one of (1) to (7) above. (9) The display unit and the plurality of sound guide pipes are provided separately from the speaker unit. The audiovisual presentation device according to any one of (1) to (8) above. (10) A plurality of the display units are provided, and the air chamber of one of the speaker units is connected to the air chamber of each display unit by a sound guide tube. The audiovisual presentation device according to any one of (1) to (9) above. (11) A speaker unit is provided for each air chamber provided in the display unit. The audiovisual presentation device according to (10) above. (12) A plurality of the audiovisual presentation devices are arranged in a tiled pattern to form an audiovisual presentation system. The audiovisual presentation device according to any one of (1) to (11) above. (13) An audio signal of the audio output from each of the plurality of audiovisual presentation devices is generated according to the object audio data or the scene-based audio data. The audiovisual presentation device according to (12) above. (14) a display unit having light-emitting elements arranged in an array on a substrate for displaying an image, and a plurality of microholes formed in the substrate; a speaker unit having a speaker that outputs sound to an air chamber according to an acoustic signal; a plurality of sound conduits connecting the air chamber and the plurality of micropores; a plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits; a plurality of micro-speakers arranged in an array on the substrate of the display unit and outputting sounds in a higher frequency range than the speakers of the speaker unit; A signal processing device for a visual and audio presentation device comprising: an opening / closing control unit that controls opening and closing by the plurality of opening / closing mechanisms; a selector unit that controls selection of the plurality of micro-speakers; a controller that controls the opening / closing control unit and the selector unit according to the position of a sound source on the image displayed on the display unit; A signal processing device comprising:

[0103] It should be noted that the present embodiment is not limited to the above-described embodiment, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained. [Explanation of symbols]

[0104] 11 audiovisual presentation device, 12 display unit, 13 speaker unit, 14 sound guide tube, 21 circuit board, 22 light-emitting substrate, 23 transparent substrate, 24 micropore, 31 speaker body, 32 enclosure, 33 air chamber, 41 opening / closing mechanism, 51 microspeaker, 52 speaker element, 53 enclosure, 61 sound guide tube, 71 cabinet, 72 audiovisual presentation system, 101 signal processing device, 102 low-pass filter, 103 amplifier, 104 high-pass filter, 105 delay element, 106 amplifier, 107 selector, 108 controller, 109 opening / closing control device, 111 demultiplexer, 112 video decoder, 113 audio decoder, 114 video output signal line, 115 Audio Output Signal Line, 121 Channel Audio Renderer, 122 Object Audio Renderer, 123 Scene-Based Audio Renderer

Claims

1. a display unit configured by laminating a light-emitting substrate on which light-emitting elements for displaying images are arranged in an array, a circuit board on which a drive circuit for driving light emission in the light-emitting substrate is provided, and a transparent substrate provided to protect the light-emitting substrate, the display unit having a plurality of micropores provided so as to penetrate from the circuit board through the light-emitting substrate to the transparent substrate; a speaker unit having a speaker that outputs sound to an air chamber according to an acoustic signal; a plurality of sound guide tubes connecting the air chamber and the plurality of micropores; An audio-visual presentation device comprising:

2. The plurality of sound guide tubes are configured to have substantially the same path length from the air chamber of the speaker unit to the plurality of microholes. The audiovisual presentation device according to claim 1 .

3. The plurality of sound guide tubes are configured so that their inner diameters increase from the air chamber of the speaker unit toward the plurality of microholes. The audiovisual presentation device according to claim 1 .

4. A plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits The audiovisual presentation device according to claim 1 , further comprising:

5. a plurality of micro-speakers arranged in an array on the substrate of the display unit, the micro-speakers outputting sounds in a higher frequency range than the speakers of the speaker unit; The audiovisual presentation device according to claim 1 , further comprising:

6. a plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits; a plurality of micro-speakers arranged in an array on the substrate of the display unit and outputting sounds in a higher frequency range than the speakers of the speaker unit; Furthermore, The opening and closing of the plurality of opening and closing mechanisms and the selection of the plurality of micro-speakers are controlled according to the position of the sound source on the image displayed on the display unit. The audiovisual presentation device according to claim 1 .

7. The speaker unit has a plurality of speakers, which are housed in the same or separate enclosures. The audiovisual presentation device according to claim 1 .

8. further comprising a second speaker unit separate from the speaker unit; The air chamber of the second speaker unit is connected to a desired sound guide tube. The audiovisual presentation device according to claim 1 .

9. The display unit and the plurality of sound guide pipes are provided separately from the speaker unit. The audiovisual presentation device according to claim 1 .

10. A plurality of the display units are provided, and the air chamber of one of the speaker units is connected to the air chamber provided in each display unit by a sound guide tube. The audiovisual presentation device according to claim 1 .

11. A speaker unit is provided for each air chamber provided in the display unit. The audiovisual presentation device according to claim 10.

12. A plurality of the audiovisual presentation devices are arranged in a tiled pattern to form an audiovisual presentation system. The audiovisual presentation device according to claim 1 .

13. An audio signal of the audio output from each of the plurality of audiovisual presentation devices is generated according to the object audio data or the scene-based audio data. The audiovisual presentation device according to claim 12.

14. a display unit configured by laminating a light-emitting substrate on which light-emitting elements for displaying images are arranged in an array, a circuit board on which a drive circuit for driving light emission in the light-emitting substrate is provided, and a transparent substrate provided to protect the light-emitting substrate, the display unit having a plurality of micropores provided so as to penetrate from the circuit board through the light-emitting substrate to the transparent substrate; a speaker unit having a speaker that outputs sound to an air chamber according to an acoustic signal; a plurality of sound conduits connecting the air chamber and the plurality of micropores; a plurality of opening and closing mechanisms for individually opening and closing the plurality of sound conduits; a plurality of micro-speakers arranged in an array on the substrate of the display unit and outputting sounds in a higher frequency range than the speakers of the speaker unit; A signal processing device for a visual and audio presentation device comprising: an opening / closing control unit that controls opening and closing by the plurality of opening / closing mechanisms; a selector unit that controls selection of the plurality of micro-speakers; a controller that controls the opening / closing control unit and the selector unit according to the position of a sound source on the image displayed on the display unit; A signal processing device comprising:

Citation Information

Patent Citations

  • A sound-transparent display device for sound output with object-based positional coordinate effects.

    JP2012529073A

  • Game machine

    JP2014171610A

  • A sound radiating device fitted to the multiple waveguides

    KR102090246B1

  • Method and system for speaker array assembly and porous display device

    US20180343519A1

  • Iled displays with substrate holes

    US20190027534A1