Display device, control method, and program

Abstract

A display device is provided with a control unit that identifies a sound source position from an image displayed on a display unit, and performs respectively different signal processes in accordance with the sound source position on voice signals that are synchronized with the image and are outputted to a plurality of sets of speaker units including at least one set of speaker units provided in an upper section of the display unit.

Description

[Technical field]

[0001] The present disclosure relates to a display device, a control method, and a program. [Background technology]

[0002] In recent years, some display devices such as television receivers and personal computers are provided with a display having a display surface on which images are displayed, with speakers and the like arranged on the rear side of the display, and the speakers and the like covered from the rear side by a rear cover. In such display devices, the speaker is arranged on the rear side of the lower end of the display, and a slit is located below the display, which functions as a passage hole for sound output from the speaker, and the sound output from the speaker passes under the display and heads forward from the slit.

[0003] Furthermore, in recent years, displays have rapidly become thinner and lighter, and a flat panel speaker has been proposed that includes a flat panel and a plurality of vibrators disposed on the rear surface of the flat panel to vibrate the flat panel, as shown in Patent Document 1 below. The flat panel speaker outputs sound by generating vibrations in the flat panel using the vibrators. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2018 / 123310 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in conventional display devices equipped with speakers, only two speakers (LR) are provided at the bottom end or both ends of the rear surface of the display device, making it difficult to adequately match the positional relationship between the image and sound. [Means for solving the problem]

[0006] According to the present disclosure, a control unit is provided that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of sets of speaker units including at least one set of speaker units provided on an upper portion of the display unit, depending on the sound source position, and the plurality of sets of speaker units include a plurality of sets of two speakers that reproduce audio signals of two channels, one for left and one for right, and the plurality of sets of speaker units include a plurality of top speakers provided on an upper end of a rear surface of the display unit and a plurality of bottom speakers provided on a lower end of the rear surface of the display unit, and a portion of each of the plurality of top speakers is located above the display unit, and a portion of each of the plurality of bottom speakers is located below the display unit. and an upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. A display device is proposed.

[0007] According to the present disclosure, a processor includes a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of sets of speaker units including at least one set of speaker units provided on an upper portion of the display unit, depending on the sound source position, the plurality of sets of speaker units including a plurality of sets of two speakers that reproduce audio signals of two channels, left and right, the plurality of sets of speaker units including a plurality of top speakers provided on an upper end of a rear surface of the display unit and a plurality of bottom speakers provided on a lower end of the rear surface of the display unit, a portion of each of the plurality of top speakers being positioned above the display unit, and a portion of each of the plurality of bottom speakers being positioned below the display unit. and an upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. A control method is proposed.

[0008] According to the present disclosure, a computer is caused to function as a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of sets of speaker units including at least one set of speaker units provided on an upper portion of the display unit, depending on the sound source position, the plurality of sets of speaker units including a plurality of sets of two speakers that reproduce audio signals of two channels, left and right, the plurality of sets of speaker units including a plurality of top speakers provided on an upper end of a rear surface of the display unit and a plurality of bottom speakers provided on a lower end of the rear surface of the display unit, a portion of each of the plurality of top speakers being positioned above the display unit, and a portion of each of the plurality of bottom speakers being positioned below the display unit. and an upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. We propose a program to achieve this. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a display device according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating an arrangement of speakers in a display device according to an embodiment of the present disclosure. [Diagram 3] 1A to 1C are diagrams illustrating an example of the external configuration of a display device that emits sound waves in a forward direction according to an embodiment of the present disclosure. [Figure 4] FIG. 11 is a diagram illustrating signal processing according to a comparative example. [Diagram 5] 3A to 3C are diagrams illustrating each process of an audio signal to be output to each speaker according to an embodiment of the present disclosure. [Figure 6] FIG. 2 is a diagram illustrating adjustment of the positional relationship between an image and sound according to the first embodiment. [Figure 7] 5 is a flowchart showing an example of the flow of audio output processing according to the first embodiment. [Figure 8] 13A to 13C are diagrams illustrating adjustment of the positional relationship between an image and sound according to a second embodiment. [Figure 9] FIG. 11 is a diagram illustrating signal processing according to a second embodiment. [Figure 10]FIG. 11 is a diagram illustrating the positional relationship between a display device and a viewer according to a third embodiment. [Figure 11] FIG. 13 is a diagram illustrating signal processing according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0011] The description will be given in the following order: 1. Display device configuration example 2. Working Example 2-1. First embodiment 2-2. Second Example 2-3.Third Example 2-4. Fourth embodiment 3. Summary

[0012] Hereinafter, an embodiment of a display device according to the present disclosure will be described with reference to the accompanying drawings. In the following, the present technology will be described as being applied to a television receiver that displays images on a display, but the scope of application of the present technology is not limited to television receivers, and the present technology can be widely applied to various display devices such as monitors used in personal computers, etc.

[0013] In the following description, the direction toward which the display surface of a display device (television receiver) faces is defined as the front side (front face), and directions such as front, back, up, down, left and right are indicated.

[0014] <<1. Display device configuration example>> 1 is a diagram illustrating an example of the configuration of a display device according to an embodiment of the present disclosure. As shown in FIG 1, the display device 10 includes a control unit 110, a display unit 120, an audio output unit 130, a tuner 140, a communication unit 150, a remote control receiving unit 160, and a storage unit 170.

[0015] (Display section 120) The display unit 120 displays images of program contents selected and received by the tuner 140, an EPG (Electronic Program Guide), data broadcasting contents, and an OSD (On-Screen Display). The display unit 120 is realized, for example, by a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. The display unit 120 may also be realized by a flat panel speaker. The flat panel speaker generates vibrations in the flat panel using a plurality of vibrators provided on the rear surface of the flat panel to output sound, and is integrated with a display device that displays images and configured to output sound from the display surface. The panel unit has, for example, a thin plate-shaped display cell (display cell acting as a diaphragm) that displays images, and an inner plate (substrate that supports the vibrators) that is disposed opposite the display cell with a gap therebetween.

[0016] (Audio output unit 130) The audio output unit 130 is configured with an acoustic generating element that reproduces an audio signal. The audio output unit 130 may use the above-mentioned flat panel speaker (diaphragm (display unit) and vibrator) in addition to a cone-type speaker.

[0017] The audio output unit 130 is composed of a plurality of speaker units including at least one speaker unit provided at the upper end of the back side of the display unit 120. The speaker unit means a speaker housing including at least one sound generating element for reproducing an audio signal. In the configuration example shown in FIG. 1, as an example, a configuration having a pair of speaker units (hereinafter referred to as upper speaker 131) provided at the upper end of the back side of the display unit 120 and a pair of speaker units (hereinafter referred to as lower speaker 132) provided at the lower end of the back side of the display unit 120 is used. FIG. 2 shows an example of the arrangement of speakers in the display device 10 according to the present embodiment. In the example shown in FIG. 2, a plurality of sound generating elements (for example, cone-type speakers) that emit sound waves are provided on the back side of the display unit 120-1.

[0018] 2, when display unit 120-1 is viewed from the front, upper speaker (speaker unit) 131L is disposed on the left side of the top end (Top) and upper speaker (speaker unit) 131R is disposed on the right side. Also, lower speaker (speaker unit) 132L is disposed on the left side of the bottom end (Bottom) and lower speaker (speaker unit) 132R is disposed on the right side.

[0019] More specifically, an audio passage hole (not shown) is formed around the speaker unit, and sound waves generated in the speaker unit are emitted to the outside of the display device 10 through the audio passage hole. The emission direction of sound waves in the display device 10 can be up, down, left, or right depending on the position of the audio passage hole. In this embodiment, as an example, an audio passage hole is provided so as to emit sound waves in the forward direction. Here, FIG. 3 shows an example of the external configuration of a display device that emits sound waves in the forward direction according to this embodiment. Note that the external configuration shown in FIG. 3 (the emission direction of sound waves and the structure around the audio passage hole) is an example, and the present disclosure is not limited thereto.

[0020] As shown in FIG. 3, inside the display device 10, the upper speaker 131L is arranged on the upper left side of the back surface of the display unit 120-1, the upper speaker 131R is arranged on the upper right side of the back surface, the lower speaker 132L is arranged on the lower left side of the back surface, and the upper speaker 131R is arranged on the lower right side of the back surface. It is preferable that a part of the upper speaker 131 is located above the display unit 120-1 (so that the entire upper speaker 131 is not located above the display). It is also preferable that a part of the lower speaker 132 is located below the display unit 120-1 (so that the entire lower speaker 132 is not located below the display unit 120-1). Since a part of the speaker unit is provided protruding from the display unit 120-1 and sound waves are emitted to the outside in the forward direction, even if a high-frequency sound is generated from the speaker, it can be output to the outside of the display device 10 without degrading the sound quality. Furthermore, since the entire speaker unit is not located above or below display section 120-1, the frame of display device 10 can be made smaller.

[0021] Sound is output forward from each upper speaker 131. Slits 180 functioning as sound passage holes are provided in the upper frame of display unit 120-1, and sound emitted from upper speakers 131 is emitted outside display device 10 through slits 180.

[0022] Similarly, sound is output forward from each lower speaker 132. A slit 182 functioning as a sound passage hole is provided in the lower frame of display unit 120-1, and sound emitted from upper speaker 131 is emitted outside display device 10 through slit 182.

[0023] The sound waves of the sounds output from the upper speaker 131 and the lower speaker 132 reach the viewer watching the display device 10 as direct waves, and also as reflected waves from the walls, ceiling, and floor.

[0024] In this embodiment, a configuration having multiple sets of speaker units including at least one set of speaker units located on the upper end side processes the audio signals output to each speaker unit, and ensures that the positional relationship between the image and sound is fully matched, thereby creating a sense of unity between the image and sound and achieving a good viewing experience.

[0025] (Control unit 110) The control unit 110 functions as an arithmetic processing device and a control device, and controls the overall operation of the display device 10 in accordance with various programs. The control unit 110 is realized by electronic circuits such as a CPU (Central Processing Unit) and a microprocessor. The control unit 110 may also include a ROM (Read Only Memory) that stores programs to be used, arithmetic parameters, etc., and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.

[0026] The control unit 110 also functions as a sound source position identifying unit 111 and a signal processing unit 112 .

[0027] The sound source position identifying unit 111 analyzes the image displayed on the display unit 120 to identify the sound source position. Specifically, the sound source position identifying unit 111 identifies each object included in the image (image recognition of a person, object, etc.), the movement of each identified object (e.g., mouth movement), and the position of each object in the image (xy coordinates), and identifies the sound source position. For example, when analyzing that a person's mouth is moving by image recognition in a certain scene, the sound source position of the person's voice reproduced in synchronization with the scene is the mouth (face position) of the person recognized in the image. Depending on the result of image analysis, the sound source position may be the entire screen. Also, the sound source position may not be within the screen, in which case the outside of the screen may be identified as the sound source position.

[0028] The signal processing unit 112 has a function of processing the audio signal to be output to the audio output unit 130. Specifically, the signal processing unit 112 performs signal processing to make the sound image appear as if it were localized at the sound source position identified by the sound source position identification unit 111. More specifically, the signal processing unit 112 adjusts at least one of the range, sound pressure, and delay for each audio signal output to each speaker of a plurality of speaker units including at least one speaker unit provided at the upper end side of the back side of the display unit 120, thereby realizing pseudo sound source localization. Generally, when hearing sounds emitted from a plurality of speakers, the human ear perceives the direction of the sound that is louder, higher in frequency, and arrives earlier as the direction of the sound source, and recognizes it as one sound. Therefore, depending on the positional relationship between the sound source position in the image and the installation positions of each speaker, the signal processing unit 112 processes the sound output from the speaker located closest to the sound source position in the image to have a louder volume (higher sound pressure) in the high range than the sound output from the other speakers, and to have a smaller delay (to reach the viewer's ears earlier than the sound from the other speakers), thereby achieving pseudo sound source localization.

[0029] In addition, if the sound source position in the image is at the same distance between the two speakers, the sound output from those two speakers is processed to be louder (increased sound pressure) in the high frequencies than the sound output from the other speakers, and with less delay (reaching the viewer's ears sooner than the sound from the other speakers).

[0030] In a comparative example in which two speakers are provided spaced apart from each other on the left and right, a left channel audio signal (L signal) may be subjected to signal processing and output to the L speaker, and a right channel audio signal (R signal) may be subjected to signal processing and output to the R speaker, as shown in Fig. 4. In contrast, in this embodiment, as shown in Fig. 5, different signal processing may be performed on the audio signal (L signal) output to the Top L speaker (upper speaker 131L), the audio signal (R signal) output to the Top R speaker (upper speaker 131R), the audio signal (L signal) output to the Bottom L speaker (lower speaker 132L), and the audio signal (R signal) output to the Bottom R speaker (lower speaker 132R). In each signal processing, at least one of the following is performed depending on the positional relationship between the identified sound source position and each speaker: adjustment of the sound range by a filter (a correction curve may be used), delay processing, and volume adjustment (i.e., sound pressure adjustment).

[0031] Furthermore, the signal processing unit 112 may perform the above signal processing (particularly the adjustment of the sound range) taking into consideration the characteristics of each speaker. The characteristics of each speaker are function (specification) characteristics (including frequency characteristics, etc.) and environmental characteristics (arrangement), and these characteristics may differ for each speaker. For example, as shown in FIG. 3, an upper speaker 131 arranged on the upper side and a lower speaker 132 arranged on the lower side may have environmental differences such as expected reflected sounds of emitted sounds (reflections on the ceiling, reflections on the floor surface (TV stand)) and whether the sound reaches the viewer from above or below. In addition, differences may occur in the structural environment around the speaker units, such as how much each speaker protrudes from the display unit 120-1 and how many slits there are. Furthermore, the specifications of each speaker unit may differ. Taking these characteristics into consideration, the signal processing unit 112 prepares and applies a correction curve for each audio signal output to each speaker to pseudo-localize a sound source at a predetermined sound source position. The correction curve may be generated each time, or may be generated in advance.

[0032] (Tuner 140) The tuner 140 selects and receives broadcast signals of terrestrial broadcasting and satellite broadcasting.

[0033] (Communication unit 150) The communication unit 150 is connected to an external network such as the Internet by using wired communication such as Ethernet (registered trademark) or wireless communication such as Wi-Fi (registered trademark). For example, the communication unit 150 may be interconnected with each CE device in the home via a home network in accordance with a standard such as DLNA (registered trademark) (Digital Living Network Alliance), and may further include an interface function with an IoT device.

[0034] (Remote control receiver 160) The remote control receiving unit 160 receives and processes remote control commands transmitted from a remote controller (not shown) using infrared communication, short-distance wireless communication, or the like.

[0035] (Storage unit 170) The storage unit 170 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used in the processing of the control unit 110, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate. Furthermore, the storage unit 170 is composed of a large-capacity recording device such as a HDD (Hard Disk Drive), and is mainly used for recording the content received by the tuner 140. Note that a storage device that is externally connected to the display device 10 via an interface such as an HDMI (registered trademark) (High-Definition Multimedia Interface) or a USB (Universal Serial Bus) may also be used.

[0036] The configuration of the display device 10 has been specifically described above. Note that the configuration of the display device 10 according to the present disclosure is not limited to the example shown in FIG. 1. For example, at least a part of the functional configuration of the control unit 110 may be provided in an external device (for example, an information processing device that is communicatively connected to the display device 10, or a server on a network). Also, the display unit 120 and the audio output unit 130 may be configured separately from the control unit 110 and may be configured in a system that is communicatively connected.

[0037] <<2. Example>> Next, each example of this embodiment will be specifically described with reference to the drawings.

[0038] <2-1. First Example> FIG. 6 is a diagram for explaining the adjustment of the positional relationship between an image and sound according to the first embodiment. As shown in FIG. 6, in this embodiment, the video displayed on the display unit 120-1 is analyzed to recognize object 1 (person 1) and object 2 (person 2), and the sound source position is identified from the movement of each object. Next, the audio signals to be output to each speaker (upper speaker 131L, upper speaker 131R, lower speaker 132L, and upper speaker 131R) are each processed so that a corresponding (synchronized) sound can be heard from the direction of the identified sound source position (see FIG. 5). Note that when the audio signal includes multiple sound sources (such as dialogue and sound effects), the sound sources may be separated and signal processed separately.

[0039] Specifically, in the case of a dialogue voice in which the object 1 (person 1) shown in Fig. 6 is the sound source position, the sound signal output to the speaker closer to the display position (sound source position) of the mouth (or face, etc.) of the object 1 has a higher sound pressure, the higher the high frequency is emphasized, and each sound signal is processed so that it reaches the ears of the viewer first. That is, if the sound signal output to the upper speaker 131L is a ToP;L signal, the sound signal output to the upper speaker 131R is a ToP;R signal, the sound signal output to the lower speaker 132L is a Bottom;L signal, and the sound signal output to the lower speaker 132R is a Bottom;R signal, the adjustment of each sound signal is as follows. The degree of difference between each of the sound signals can be determined based on the positional relationship with the sound source position, and preset parameters, upper limit values, and lower limit values.

[0040] When the sound source is the mouth of object 1 High sound pressure and emphasis on high frequencies Top;L signal>Top;R signal≧Bottom;L signal>Bottom;R signal (The Top;R signal and Bottom;L signal can be either on top or can be the same.) Delay (playback timing delay) amount Bottom;R signal>Bottom;L signal≧Top;R signal>Top;L signal

[0041] Similarly, in the case of a dialogue voice in which the object 2 (person 2) shown in FIG. 6 is the sound source position, the following is obtained.

[0042] When the sound source is the mouth of object 2 High sound pressure and emphasis on high frequencies Bottom;R signal>Top;R signal≧Bottom;L signal>Top;L signal Delay Magnitude Top;L signal>Top;R signal≧Bottom;L signal>Bottom;R signal

[0043] FIG. 7 is a flowchart showing an example of the flow of the audio output process according to the first embodiment.

[0044] As shown in FIG. 7, first, the sound source position identifying unit 111 identifies the sound source position by image recognition (step S103).

[0045] Next, the signal processing unit 112 performs different signal processing on the audio signals to be output to each speaker depending on the relative positional relationship between the identified sound source position and each speaker, so as to pseudo-localize the audio signals to the sound source position (step S106).

[0046] Then, the control unit 110 outputs the processed audio signals to each speaker to output audio (step S109).

[0047] <2-2. Second Example> The second embodiment is a diagram for explaining processing of audio signals output to each speaker when flat speakers are used.

[0048] Fig. 8 is a diagram for explaining adjustment of the positional relationship between an image and sound according to the second embodiment. Display unit 120-2 shown in Fig. 8 is realized by a flat panel speaker, and a plurality of vibrators 134, 135, and 136 are provided on the rear surface of a flat panel formed of display cells, and sound waves are generated forward from the flat panel by vibrating the flat panel with the vibrators 134, 135, and 136.

[0049] A flat panel speaker can generate sound waves forward from the flat panel surface by vibrating the flat panel, so it is possible to stabilize sound quality even if the speaker (sound generating element) does not protrude partially from the bottom or top end as shown in Figure 3.

[0050] Therefore, for example, as shown in FIG. 8, upper vibration exciters 134L, R and lower vibration exciters 135L, R are installed slightly above and slightly below the center, respectively, and a central vibration exciter 136 can also be installed in the center.

[0051] In the case of a flat panel speaker, similarly to the first embodiment, the signal processing unit 112 analyzes the image displayed on the display unit 120-2, recognizes object 1 (person 1) and object 2 (person 2), and identifies the sound source position from the movement of each object. Next, the signal processing unit 112 processes the audio signals to be output to each of the vibration exciters (upper vibration exciter 134L, upper vibration exciter 134R, lower vibration exciter 135L, lower vibration exciter 135R, and central vibration exciter 136) so that the corresponding sound can be heard from the direction of the identified sound source position.

[0052] Fig. 9 is a diagram for explaining signal processing according to the second embodiment. As shown in Fig. 9, the signal processing unit 112 performs different signal processing depending on the sound source position, and then outputs an audio signal to each vibration exciter. Specifically, it is as follows. Here, the upper vibration exciter 134L is called Top;L, the upper vibration exciter 134R is called Top;R, the lower vibration exciter 135L is called Bottom;L, the lower vibration exciter 135R is called Bottom;R, and the center vibration exciter 136 is called Center.

[0053] When the sound source is the mouth of object 1 Top;L only, or When outputting from both Top;L and Center, the signals are processed so that the sound pressure and pitch are Top;L>Center and the delay is Center>Top;L. When the sound source is the mouth of object 2 Bottom;L only, or When outputting from both Bottom;L and Center, the signal is processed so that the sound pressure and pitch are Bottom;L>Center and the delay is Center>Bottom;L.

[0054] <2-3. Third Example> Furthermore, the display device 10 may recognize the positional relationship of the viewer to the display device 10 (the distance of the face from the display device 10, the height from the floor, etc.) with a camera, and perform signal processing to adjust the sound image to an optimal localization position.

[0055] Fig. 10 is a diagram for explaining the positional relationship between the display device 10 and the viewer according to the third embodiment. As shown in Fig. 10, when the viewer is sitting on the floor, sitting on a chair, or standing, the position (height) of the viewer's ears is different, and therefore the distance to the upper speakers 131L, R and the lower speakers 132L, R is different. Generally, the closer one is to the sound source, the more likely it is that the sound feels close. Therefore, when performing the first embodiment or the second embodiment described above, the signal processing unit 112 weights the adjustment of the signal processing in consideration of the height of the viewer's ears, thereby realizing optimal sound image localization.

[0056] For example, when a viewer sits on the floor (user A's position) and is closer to the lower speakers 132L, R (Bottom; L, R) than the upper speakers 131L, R (Top; L, R), the sound from the lower speakers 132L, R is likely to feel closer. Therefore, the signal processing described above is corrected by weighting the sound pressure or range as Top; L, R > Bottom; L, R, or the delay magnitude as Bottom; L, R > Top; L, R. Note that each L / R can be appropriately selected depending on whether the user is positioned to the left of the display device 10 (closer to the L speaker) or to the right (closer to the R speaker).

[0057] Also, when the viewer sits on a chair (user B's position) and the distances between the upper speakers 131L, R (Top; L, R) and the lower speakers 132L, R (Bottom; L, R) are approximately the same, the sound source positions are equally close, so weighting or other corrections may not be performed. However, when the user is positioned to the left (closer to the L speaker) or right (closer to the R speaker) of the display device 10, the sound generated from the closer side tends to feel closer, so appropriate weighting may be performed. Specifically, when the viewer is positioned to the right, weighting is performed such that the sound pressure and the sound range are Top; L>Top; R, Bottom; L>Bottom; R, and the delay magnitude is Top; R, Bottom; R>Top; L, Bottom; L.

[0058] Also, when a viewer is standing (position of user C) and is closer to the upper speakers 131L, R (Top;L,R) than the lower speakers 132L, R (Bottom;L,R), the sound from the upper speakers 131L, R is likely to feel closer. Therefore, the signal processing described above is corrected by weighting the sound pressure or range as Bottom;L,R>Top;L,R, or the delay magnitude as Top;L,R>Bottom;L,R. Note that each L / R can be appropriately selected depending on whether the user is positioned to the left of the display device 10 (closer to the L speaker) or to the right (closer to the R speaker).

[0059] <2-4. Fourth Example> In addition to the L and R signals (L channel signal and R channel signal), a Hight signal, which is a sound source in the height direction that can create a three-dimensional sound space and reproduce the movement of the sound source in accordance with the video, may be added to the audio signal. As shown in Figs. 2, 3, and 8, the display device 10 according to this embodiment has a structure that includes a pair of sound reproduction elements on the upper side as well, so that when reproducing such a Hight signal, it is possible to reproduce a realistic sound with added height components by synthesizing and outputting from the upper sound reproduction elements (upper speakers 131L, R, upper vibrators 134L, R) without providing a separate dedicated speaker. Signal processing in this case is shown in Fig. 11.

[0060] Fig. 11 is a diagram for explaining signal processing according to the fourth embodiment. As shown in Fig. 11, appropriate signal processing is performed on the Hight signal, and the Hight signal is added to the L signal and the R signal output to Top;L,R, respectively.

[0061] <<3. Summary>> Although the preferred embodiment of the present disclosure has been described in detail above with reference to the accompanying drawings, the present technology is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.

[0062] For example, although a structure in which a plurality of speaker units are provided at the lower end and the upper end has been mainly described, the present disclosure is not limited thereto, and a pair of speaker units may be provided at both ends, and the arrangement of the speaker units at the lower end and the upper end is not limited to the example shown in the drawings. In any arrangement, the display device 10 processes the audio signal to be output to each speaker according to the positional relationship between the sound source position obtained by analyzing the image and each speaker, and can realize pseudo sound image localization.

[0063] Furthermore, when the sound source position is not within the screen, signal processing may be performed so that the center of the screen or outside the screen, etc., is perceived as the sound source position depending on the sound. For example, for sounds such as background music (BGM), the sound source position may be the center of the screen, and for the sound of an airplane flying from the upper left outside the screen, the sound source position may be the upper left of the screen (for example, vibration processing may be performed so that the sound is heard from a speaker located at the upper left).

[0064] It is also possible to seamlessly control the processing of the audio signals output to each speaker in accordance with the movement of the sound source position.

[0065] In addition to multiple speaker units, one or more subwoofers may be provided to handle low-frequency reproduction (WF (Woofer)) (to compensate for low-frequency ranges that are not sufficient with multiple speaker units). For example, a subwoofer may be applied to the configuration shown in FIG. 2 or the configuration shown in FIG. 8. In this case as well, it is possible to process the audio signals output to each speaker according to the positional relationship between the sound source position identified from the image and each speaker (including the subwoofer), and perform pseudo sound source localization.

[0066] It is also possible to create a computer program for causing hardware such as a CPU, a ROM, and a RAM built into the above-mentioned display device 10 to perform the functions of the display device 10. Also provided is a computer-readable storage medium storing the computer program.

[0067] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.

[0068] The present technology can also be configured as follows. (1) A display device comprising a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to multiple sets of speaker units including at least one set of speaker units provided above the display unit, depending on the sound source position. (2) The control unit is The display device according to (1), wherein signal processing is performed according to a relative positional relationship of each speaker unit with respect to the sound source position. (3) The control unit is The display device according to (2) above, wherein the signal processing is performed by further taking into consideration at least the function or environment of each speaker unit. (4) The control unit is The display device according to any one of claims (1) to (3), wherein the audio signal is subjected to at least one of frequency band correction, sound pressure adjustment, and playback timing delay processing, thereby performing sound image localization processing corresponding to the sound source position. (5) The control unit is The display device according to any one of (1) to (4), wherein the display device performs signal processing such that the closer the speaker unit is to the sound source position, the more emphasized the high-frequency component of the audio signal. (6) The control unit is The display device according to any one of (1) to (5), wherein the display device performs signal processing such that the closer the speaker unit is to the sound source position, the higher the sound pressure of the audio signal is. (7) The control unit is The display device according to any one of (1) to (6), wherein the amount of delay in the reproduction timing of the audio signal is increased as the speaker unit is farther from the sound source position. (8) The display device includes: The display device according to any one of (1) to (7), wherein the plurality of sets of speakers include a plurality of sets of two speakers for reproducing audio signals of two channels, left and right. (9) The display device described in (8), wherein the plurality of sets of speakers include a plurality of top speakers provided at an upper end of the rear surface of the display unit and a plurality of bottom speakers provided at a lower end of the rear surface of the display unit. (10) The display unit is a plate-shaped display panel, The speaker is a vibration unit that vibrates the display panel to output sound, the plurality of sets of speakers include a plurality of vibration units provided on an upper portion of a rear surface of the display panel and a plurality of vibration units provided on a lower portion of the rear surface of the display panel; The display device according to (8), further comprising a vibration unit provided at the center of a rear surface of the display panel. (11) The processor: A control method including a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to multiple sets of speaker units including at least one set of speaker units provided above the display unit, depending on the sound source position. (12) Computer, A program for functioning as a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to multiple sets of speaker units including at least one set of speaker units provided above the display unit, depending on the sound source position. [Explanation of symbols]

[0069] 10 Display device 110 Control section 111 Sound source location identification section 112 Signal Processing Section 120 Display section 130 Audio output section 131 (131L, 131R) Upper speaker (speaker unit) 132 (132L, 132R) Lower speaker (speaker unit) 134 (134L, 134R) Upper exciter 135 (135L, 135R) Lower exciter 136 Central Exciter 140 Tuner 150 Communications Department 160 Remote control receiver 170 Storage section 180 Slit 182 Slit

Claims

1. a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of speaker units including at least one speaker unit provided above the display unit, depending on the sound source position; The plurality of speaker units include a plurality of pairs of two speakers for reproducing audio signals of two channels, one for left and one for right, the plurality of speaker units include a plurality of top speakers provided at an upper end of a rear surface of the display unit and a plurality of bottom speakers provided at a lower end of the rear surface of the display unit; A portion of each of the plurality of top speakers is positioned above the display unit, and a portion of each of the plurality of bottom speakers is positioned below the display unit, An upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. Display device.

2. The control unit is The display device according to claim 1 , wherein signal processing is performed according to a relative positional relationship of each speaker unit with respect to the sound source position.

3. The control unit is The display device according to claim 2 , wherein the signal processing is performed by further taking into consideration at least a function or an environment of each speaker unit.

4. The control unit is The display device according to claim 1 , further comprising: a display unit configured to perform, on the audio signal, at least one of a frequency band correction, a sound pressure adjustment, and a playback timing delay process, thereby performing a sound image localization process corresponding to the sound source position.

5. The control unit is The display device according to claim 1 , wherein signal processing is performed such that the closer the speaker unit is to the sound source position, the more emphasized the high-frequency components of the audio signal.

6. The control unit is The display device according to claim 1 , wherein the speaker unit performs signal processing such that the closer the speaker unit is to the sound source position, the higher the sound pressure of the audio signal is.

7. The control unit is The display device according to claim 1 , wherein the delay amount of the reproduction timing of the audio signal is increased as the speaker unit is farther away from the sound source position.

8. The processor: a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of speaker units including at least one speaker unit provided above the display unit, according to the sound source position; The plurality of speaker units include a plurality of pairs of two speakers each reproducing audio signals of two channels, left and right, the plurality of speaker units include a plurality of top speakers provided at an upper end of a rear surface of the display unit and a plurality of bottom speakers provided at a lower end of the rear surface of the display unit; A portion of each of the plurality of top speakers is positioned above the display unit, and a portion of each of the plurality of bottom speakers is positioned below the display unit, An upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. Control methods.

9. Computer, a control unit that identifies a sound source position from an image displayed on a display unit, and performs different signal processing on audio signals synchronized with the image and output to a plurality of speaker units including at least one speaker unit provided above the display unit, depending on the sound source position; The plurality of speaker units include a plurality of pairs of two speakers each reproducing audio signals of two channels, left and right, the plurality of speaker units include a plurality of top speakers provided at an upper end of a rear surface of the display unit and a plurality of bottom speakers provided at a lower end of the rear surface of the display unit; A portion of each of the plurality of top speakers is positioned above the display unit, and a portion of each of the plurality of bottom speakers is positioned below the display unit, An upper frame and a lower frame of the display unit are each provided with a sound passage hole for emitting sound waves from each of the plurality of top speakers and the plurality of bottom speakers in a forward direction. A program for.

Images