Display device and audio output method thereof
By employing asynchronous sound output from the first and second speakers in the video playback device, and utilizing obstacle reflections and volume ratio adjustments, the problem of poor stereo effect was solved, achieving precise synchronization between sound and image, thus improving the user experience.
Patent Information
- Application Number
- CN202110396109.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-13
- Publication Date
- 2026-01-30
- Estimated Expiration
- 2041-04-13
AI Technical Summary
Existing video playback devices have poor stereo sound effects, resulting in misalignment between the image and sound, leading to a poor user experience.
The system employs asynchronous sound emission from the first and second speakers. The first speaker emits sound towards the upper rear of the display device, and the sound is reflected by obstacles to the user's viewing area. The second speaker emits sound towards the front or lower. By controlling the time difference and volume ratio of the sound, the position of the sound image is adjusted to achieve precise synchronization between the sound image and the picture.
It improves stereo sound effects, ensures synchronization between sound and image, enhances the user's audiovisual experience, and is suitable for application environments with various spatial parameters.
Smart Images

Figure CN115209077B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of television equipment, and in particular to a display device and its audio output method. Background Technology
[0002] Existing video playback devices, such as flat-screen TVs, have at least two speakers to achieve stereo sound. However, the stereo sound quality of existing video playback devices is not good. Summary of the Invention
[0003] This application provides a display device aimed at achieving good stereo sound. This application also provides an audio output method for the display device to improve its stereo sound effect.
[0004] In a first aspect, a display device is provided. The display device includes a display screen, a first speaker, and a second speaker. The first speaker is located behind the display screen and its sound emission direction is towards the upper rear of the display device. The second speaker's sound emission direction is towards the front of the display device or towards the bottom of the display device. The first speaker and the second speaker emit sound asynchronously.
[0005] It is understandable that the direction of sound emission from the first speaker is the initial direction of sound propagation emitted by the first speaker, and the direction between the rear and top of the display device is the direction between the rear and top of the display device.
[0006] This application restricts the first and second speakers from emitting sound asynchronously, allowing users to receive the sound emitted by the first and second speakers simultaneously. The sound image positions formed by the sound emitted by the first and second speakers are more accurate, and there will be no misalignment between the image and the sound image positions, thus achieving precise synchronization between the sound image position and the image, resulting in better stereo sound and improved user experience.
[0007] In one possible implementation, sound emitted by the first speaker is reflected by a first obstacle located behind the display device to a second obstacle located above the display device, and then reflected by the second obstacle to the user's viewing area in front of the display device. The first obstacle can be a wall, and the second obstacle can be a ceiling.
[0008] The first speaker directs its sound towards the rear and upper part of the display device, meaning its axial direction is also towards the rear and upper part of the display device. Because the first speaker's axial direction is towards the rear and upper part of the display device, most of the sound from the first speaker is directed towards a first obstacle located behind the display device. After being reflected by the first obstacle, it is reflected again by a second obstacle located above the display device before reaching the user's viewing area. A small portion of the sound from the first speaker deviates significantly from its axial direction and can directly reach the user's viewing area directly in front of the display device. However, this portion of sound has a large off-axis angle and is relatively weak. Therefore, the sound directly reaching the user's viewing area has a weak masking effect on the sound that has been reflected twice by the walls and ceiling, resulting in better ceiling-reflected sound image localization and improving the user's audiovisual experience.
[0009] Simultaneously, the sound emitted by the first speaker is reflected by the first obstacle to the second obstacle, and then reflected by the ceiling before being projected onto the user's viewing area. The sound image transmitted to the user's viewing area is a sound image located above the ceiling. In this way, the sound field range in the height direction formed by the first speaker is not limited to the size of the display screen, allowing the sound field in the height direction to cover the entire spatial height of the application environment, achieving the effect of sky sound image positioning. For example, the sound image of an aircraft engine can be located above the display screen and played through the first speaker, so that the picture and sound positioning of the display screen are consistent.
[0010] In one possible implementation, the sound output direction of the first speaker is at an angle of 10 to 80 degrees (inclusive) to the horizontal direction, so as to ensure that the sound emitted by the first speaker is reflected sequentially by the wall and ceiling before finally reaching the user's viewing area. Here, the horizontal direction is the direction perpendicular to the display surface of the screen.
[0011] In one possible implementation, the sound emission direction of the first speaker is at an angle of 35 to 45 degrees (inclusive) to the horizontal. When the sound emission direction of the first speaker is at an angle of 35 to 45 degrees to the horizontal, the display device can be applied to various application environments with different spatial parameters. When applied to various application environments with different spatial parameters, the sound emitted by the first speaker can be reflected sequentially by the walls and ceilings of different application environments, ultimately reaching the user's viewing area. Spatial parameters are a set of multiple different parameters, such as the distance from the display device to the wall, the distance from the display device to the ceiling, and the distance from the display device to the user. In other words, the display device can be applied to various application environments with different spatial parameters within a certain distance from the wall, a certain distance from the ceiling, and a certain distance from the user, ensuring the user's audiovisual experience.
[0012] In one possible implementation, a first speaker emits a first sound at a first moment, and a second speaker emits a second sound corresponding to the first sound at a second moment. The first and second sounds are mixed in the user's viewing area; there is a time difference between the first and second moments. By controlling the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, the user can simultaneously receive the sounds emitted by the first and second speakers at a third moment. This results in more accurate sound image positioning, preventing any misalignment between the image and the sound image, thus achieving precise synchronization between the sound image and the image and improving the user experience.
[0013] In one possible implementation, when the spatial parameters of the application environment in which the display device is located change, the time difference between the first moment and the second moment changes, so as to ensure that the sound emitted by the first speaker and the second speaker arrives at the user's viewing area at the same time, so as to make the sound image positioning more accurate.
[0014] In one possible implementation, the position of the sound image formed by the first and second sounds changes when the volume ratio of the first and second sounds changes. By adjusting the volume ratio of the first and second sounds, the position of the sound image formed by the first and second sounds is adjusted, thereby achieving adjustment of the sound image position in the height direction, so that the sound image position is synchronized with the picture.
[0015] In one possible implementation, the sound-emitting direction of the first speaker is variable, and the first speaker can adjust the sound-emitting direction as needed so that the sound emitted by the first speaker can be accurately transmitted to the user's viewing area.
[0016] In one possible implementation, the sound emission direction of the first speaker can be varied when the spatial parameters of the application environment in which the display device is located change. By adjusting the sound emission direction of the first speaker through spatial parameters, automatic adjustment of the sound emission direction of the first speaker can be achieved, thereby improving the user experience.
[0017] In one possible implementation, the spatial parameters include at least one of a first distance, a second distance, and a third distance. The first distance is the distance between the display device and a first obstacle, the second distance is the distance between the display device and a second obstacle, and the third distance is the distance between the display device and the user. The display device can adjust the position of the user's viewing area according to the user's location, so that the user can have a good audiovisual experience no matter where they move.
[0018] In one possible implementation, the display device includes a top and a bottom, with a second speaker positioned closer to the bottom relative to the first speaker, so that the user receives a combined sound formed by sounds emitted from speakers in different locations, thereby enhancing the stereo effect of the sound.
[0019] In one possible implementation, the display device further includes a processor coupled to both the first speaker and the second speaker. The processor adjusts the position of the sound image formed by the first and second sounds by controlling the ratio of the volume of the first sound emitted by the first speaker to the volume of the second sound emitted by the second speaker, thereby adjusting the position of the sound image in the height direction so that the position of the sound image is synchronized with the screen.
[0020] In one possible implementation, the processor further controls a first speaker to emit a first sound at a first moment, and controls a second speaker to emit a second sound at a second moment. The user receives the first and second sounds simultaneously or almost simultaneously at a third moment, where there is a time difference between the first and second moments. By controlling the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, the user can receive the sounds emitted by the first and second speakers simultaneously at the third moment. This results in more accurate sound image positioning, preventing any misalignment between the image and the sound image, thus achieving precise synchronization between the sound image and the image and improving the user experience.
[0021] In one possible implementation, the display device further includes a driving component coupled to a processor. The processor drives the driving component to adjust the sound emission direction of the first speaker. The first speaker can adjust its sound emission direction as needed so that the sound emitted by the first speaker can be accurately transmitted to the user's viewing area.
[0022] In one possible implementation, the display device further includes a distance detector, which is used to detect the application environment of the display device, obtain the spatial parameters of the application environment, and change the sound emission direction of the first speaker in response to changes in the spatial parameters, so as to achieve automatic adjustment of the sound emission direction of the first speaker and improve the user experience.
[0023] In one possible implementation, the distance detector is coupled to the processor, and the distance detector sends instructions to the processor. In response to the instructions, the time difference between the first moment and the second moment changes to ensure that the sounds emitted by the first speaker and the second speaker arrive at the user's viewing area at the same time, so as to make the sound image positioning more accurate.
[0024] In one possible implementation, the distance detector includes radar. Radar provides more accurate data compared to other detectors.
[0025] In one possible implementation, the display device also includes a sensing sensor, which detects whether the display device has been moved or whether its position has changed. For example, the sensing sensor could be a gyroscope, accelerometer, etc. When the sensing sensor detects a change in the position of the display device, it can trigger a distance detector to probe the spatial parameters of the application environment. This allows the first speaker to adjust its sound emission direction according to the spatial parameters. Therefore, whenever the position of the display device changes, the distance detector will acquire the spatial parameters of the application environment, enabling the first speaker to adjust its sound emission direction accordingly, ensuring a consistently excellent audiovisual experience for the user.
[0026] In one possible implementation, the first speaker is located between the midpoint of the top and bottom and the top. That is, the first speaker is located below the top, so that the sound emitted by the first speaker towards the front of the display device is blocked by the casing of the display device, effectively reducing the sound transmitted directly from the first speaker to the user's viewing area, and making the sky sound image positioning more accurate.
[0027] In one possible implementation, the second speaker is located at the bottom and / or on the side of the display device.
[0028] Secondly, an audio output method for a display device is provided. The display device includes a display screen, a first speaker, and a second speaker. The first speaker emits sound towards the upper rear of the display device, and the second speaker emits sound towards the front of the display device or towards the lower part of the display device. The audio output method includes:
[0029] The first speaker receives the first audio information, and the second speaker receives the second audio information corresponding to the first audio information. The playback times of the first audio information and the second audio information are not synchronized.
[0030] The audio output method of this application controls the first speaker to emit sound at a first moment and the second speaker to emit sound at a second moment, so that the user can receive the sound emitted by the first speaker and the second speaker at the third moment simultaneously, resulting in good stereo effect and improved user experience.
[0031] In one possible implementation, the sound emitted by the first speaker is reflected by a first obstacle located behind the display device to a second obstacle located above the display device, and then reflected by the second obstacle to the user's viewing area in front of the display device. By directing the sound from the first speaker towards the rear and upper part of the display device, the sound reflected by the ceiling to the user's viewing area has a good sky image localization effect, improving the user's audiovisual experience.
[0032] In one possible implementation, the audio output method includes a first speaker receiving first audio information and emitting a first sound at a first moment, and a second speaker receiving second audio information and emitting a second sound corresponding to the first sound at a second moment, wherein the first sound and the second sound are mixed in the user's viewing area; wherein there is a time difference between the first moment and the second moment.
[0033] This implementation controls the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, so that the user can receive the sound emitted by the first speaker and the second speaker at the third moment. The sound image position is more accurate and there will be no misalignment between the image and the sound image position, so that the sound image position and the image are accurately synchronized, thus improving the user experience.
[0034] In one possible implementation, the position of the sound image formed by the first and second sounds changes when the volume ratio of the first and second sounds changes. In other words, by adjusting the volume ratio of the first and second audio information, the position of the sound image can be synchronized with the picture, thus achieving a realistic three-dimensional spatial sound field effect.
[0035] In one possible implementation, the audio output method further includes: detecting the application environment of the display device and obtaining the spatial parameters of the application environment; and changing the sound emission direction of the first speaker in response to changes in the spatial parameters.
[0036] It is understood that the audio output method in this embodiment can adjust the sound emission direction of the first speaker according to the application environment of the display device. When the display device is used for the first time, or when the display device is moved to a new application environment, the display device will detect the spatial parameters of the application environment through a distance detector. Then, the sound emission direction of the first speaker is adjusted according to the spatial parameters so that the display device can ensure that the sound emitted by the first speaker is accurately reflected and placed within the user's viewing area in different application environments, thereby improving the user's audiovisual experience.
[0037] In one possible implementation, the audio output method further includes: detecting the application environment of the display device and obtaining the spatial parameters of the application environment; and changing the time difference between the first moment and the second moment in response to changes in the spatial parameters, so as to ensure that the sound emitted by the first speaker and the second speaker arrive at the user's viewing area at the same time, so as to make the sound image positioning more accurate.
[0038] In one possible implementation, the spatial parameters include at least one of a first distance, a second distance, and a third distance, wherein the first distance is the distance between the display device and a first obstacle, the second distance is the distance between the display device and a second obstacle, and the third distance is the distance between the display device and the user.
[0039] In one possible implementation, the audio output method can also sense the movement status of the display device at all times. The movement status includes being moved and changes in position. When the position of the display device changes, the distance detector is triggered to detect the spatial parameters of the application environment. Based on the spatial parameters, the sound emission direction of the first speaker is adjusted. Thus, as long as the position of the display device changes, the distance detector will obtain the spatial parameters of the application environment, so that the first speaker can adjust the sound emission direction according to the spatial parameters, ensuring the user's audiovisual experience at all times.
[0040] Thirdly, a display device is provided. The display device includes a display screen, a first speaker, and a second speaker. The first speaker is located behind the display screen, and the sound emission direction of the first speaker faces the rear and upper part of the display device. The sound emission direction of the second speaker is different from that of the first speaker.
[0041] The second speaker of this application emits sound in a different direction than the first speaker, so that the user can receive sound from different directions, thus improving the stereo effect of the sound.
[0042] In one possible implementation, sound emitted by the first speaker is reflected by a first obstacle located behind the display device to a second obstacle located above the display device, and then reflected by the second obstacle to the user's viewing area in front of the display device. The first obstacle can be a wall, and the second obstacle can be a ceiling.
[0043] The first speaker directs its sound towards the rear and upper part of the display device, meaning its axial direction is also towards the rear and upper part of the display device. Because the first speaker's axial direction is towards the rear and upper part of the display device, most of the sound from the first speaker is directed towards a first obstacle located behind the display device. After being reflected by the first obstacle, it is reflected again by a second obstacle located above the display device before reaching the user's viewing area. A small portion of the sound from the first speaker deviates significantly from its axial direction and can directly reach the user's viewing area directly in front of the display device. However, this portion of sound has a large off-axis angle and is relatively weak. Therefore, the sound directly reaching the user's viewing area has a weak masking effect on the sound that has been reflected twice by the walls and ceiling, resulting in better ceiling-reflected sound image localization and improving the user's audiovisual experience.
[0044] Simultaneously, the sound emitted by the first speaker is reflected by the first obstacle to the second obstacle, and then reflected by the ceiling before being projected onto the user's viewing area. The sound image transmitted to the user's viewing area is a sound image located above the ceiling. In this way, the sound field range in the height direction formed by the first speaker is not limited to the size of the display screen, allowing the sound field in the height direction to cover the entire spatial height of the application environment, achieving the effect of sky sound image positioning. For example, the sound image of an aircraft engine can be located above the display screen and played through the first speaker, so that the picture and sound positioning of the display screen are consistent.
[0045] In one possible implementation, the sound output direction of the first speaker is at an angle of 10 to 80 degrees (inclusive) to the horizontal direction, so as to ensure that the sound emitted by the first speaker is reflected sequentially by the wall and ceiling before finally reaching the user's viewing area. Here, the horizontal direction is the direction perpendicular to the display surface of the screen.
[0046] In one possible implementation, the sound emission direction of the first speaker is variable, so that the first speaker can adjust the sound emission direction as needed, so that the sound emitted by the first speaker can be accurately transmitted to the user's viewing area.
[0047] In one possible implementation, the sound emission direction of the first speaker can be varied when the spatial parameters of the application environment in which the display device is located change. By adjusting the sound emission direction of the first speaker through spatial parameters, automatic adjustment of the sound emission direction of the first speaker can be achieved, thereby improving the user experience.
[0048] Fourthly, a display device is provided. The display device includes a display screen, a first speaker, and a second speaker. The first speaker is located behind the display screen, and the sound emission direction of the first speaker faces the upper rear of the display device; the sound emission direction of the first speaker is variable. The first speaker can adjust its sound emission direction as needed, so that the sound emitted by the first speaker can be accurately transmitted to the user's viewing area.
[0049] In one possible implementation, sound emitted by the first speaker is reflected by a first obstacle located behind the display device to a second obstacle located above the display device, and then reflected by the second obstacle to the user's viewing area in front of the display device. The first obstacle can be a wall, and the second obstacle can be a ceiling.
[0050] The first speaker directs its sound towards the rear and upper part of the display device, meaning its axial direction is also towards the rear and upper part of the display device. Because the first speaker's axial direction is towards the rear and upper part of the display device, most of the sound from the first speaker is directed towards a first obstacle located behind the display device. After being reflected by the first obstacle, it is reflected again by a second obstacle located above the display device before reaching the user's viewing area. A small portion of the sound from the first speaker deviates significantly from its axial direction and can directly reach the user's viewing area directly in front of the display device. However, this portion of sound has a large off-axis angle and is relatively weak. Therefore, the sound directly reaching the user's viewing area has a weak masking effect on the sound that has been reflected twice by the walls and ceiling, resulting in better ceiling-reflected sound image localization and improving the user's audiovisual experience.
[0051] Simultaneously, the sound emitted by the first speaker is reflected by the first obstacle to the second obstacle, and then reflected by the ceiling before being projected onto the user's viewing area. The sound image transmitted to the user's viewing area is a sound image located above the ceiling. In this way, the sound field range in the height direction formed by the first speaker is not limited to the size of the display screen, allowing the sound field in the height direction to cover the entire spatial height of the application environment, achieving the effect of sky sound image positioning. For example, the sound image of an aircraft engine can be located above the display screen and played through the first speaker, so that the picture and sound positioning of the display screen are consistent.
[0052] In one possible implementation, the sound emission direction of the first speaker can be varied when the spatial parameters of the application environment in which the display device is located change. By adjusting the sound emission direction of the first speaker through spatial parameters, automatic adjustment of the sound emission direction of the first speaker can be achieved, thereby improving the user experience.
[0053] In one possible implementation, the spatial parameters include at least one of a first distance, a second distance, and a third distance, wherein the first distance is the distance between the display device and a first obstacle, the second distance is the distance between the display device and a second obstacle, and the third distance is the distance between the display device and the user.
[0054] In one possible implementation, the position of the sound image formed by the first and second sounds changes when the volume ratio of the first and second sounds changes. By adjusting the volume ratio of the first and second sounds, the position of the sound image formed by the first and second sounds is adjusted, thereby achieving adjustment of the sound image position in the height direction, so that the sound image position is synchronized with the picture.
[0055] In one possible implementation, a first speaker emits a first sound at a first moment, and a second speaker emits a second sound corresponding to the first sound at a second moment. The first and second sounds are mixed in the user's viewing area; there is a time difference between the first and second moments. By controlling the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, the user can simultaneously receive the sounds emitted by the first and second speakers at a third moment. This results in more accurate sound image positioning, preventing any misalignment between the image and the sound image, thus achieving precise synchronization between the sound image and the image and improving the user experience.
[0056] In one possible implementation, when the spatial parameters of the application environment in which the display device is located change, the time difference between the first moment and the second moment changes, so as to ensure that the sound emitted by the first speaker and the second speaker arrives at the user's viewing area at the same time, so as to make the sound image positioning more accurate.
[0057] In one possible implementation, when the first speaker is located in a first sound-emitting direction, the time difference between a first moment and a second moment is a first time difference; when the first speaker is located in a second sound-emitting direction, the time difference between the first moment and the second moment is a second time difference. The first time difference and the second time difference are different. The time difference between the first moment and the second moment can be obtained from data such as the sound-emitting direction of the first speaker.
[0058] Fifthly, a display device is provided. The display device includes a display screen and a first speaker. The first speaker is located behind the display screen, and the sound emission direction of the first speaker is towards the rear and upper part of the display device. The sound emitted by the first speaker is reflected by a first obstacle located behind the display device to a second obstacle located above the display device, and then reflected by the second obstacle to a user viewing area in front of the display device. The first obstacle can be a wall, and the second obstacle can be a ceiling.
[0059] The first speaker of this application directs its sound emission direction toward the rear and upper part of the display device; that is, the axial direction of the first speaker is toward the rear and upper part of the display device. Because the axial direction of the first speaker is toward the rear and upper part of the display device, most of the sound from the first speaker is directed toward a first obstacle located behind the display device. After being reflected by the first obstacle, it is reflected again by a second obstacle located above the display device before reaching the user's viewing area. A small portion of the sound from the first speaker deviates significantly from its axial direction and can directly reach the user's viewing area in front of the display device. However, this portion of the sound has a large off-axis angle from the main axis of the first speaker, resulting in weaker sound intensity. Therefore, the masking effect of the sound directly reaching the user's viewing area on the sound that has been reflected twice by the wall and ceiling is weak, and the sound image localization effect of the sound reflected from the ceiling to the user's viewing area is good, improving the user's audiovisual experience.
[0060] Simultaneously, the sound emitted by the first speaker is reflected by the first obstacle to the second obstacle, and then reflected by the ceiling before being projected onto the user's viewing area. The sound image transmitted to the user's viewing area is a sound image located above the ceiling. In this way, the sound field range in the height direction formed by the first speaker is not limited to the size of the display screen, allowing the sound field in the height direction to cover the entire spatial height of the application environment, achieving the effect of sky sound image positioning. For example, the sound image of an aircraft engine can be located above the display screen and played through the first speaker, so that the picture and sound positioning of the display screen are consistent.
[0061] In one possible implementation, the sound output direction of the first speaker is at an angle of 10 to 80 degrees (inclusive) to the horizontal direction, so as to ensure that the sound emitted by the first speaker is reflected sequentially by the wall and ceiling before finally reaching the user's viewing area. Here, the horizontal direction is the direction perpendicular to the display surface of the screen.
[0062] In one possible implementation, the display device further includes a second speaker, the second speaker emitting sound in the direction of the front of the display device or below the display device.
[0063] In one possible implementation, when the volume ratio of the first sound emitted by the first speaker and the second sound emitted by the second speaker changes, the position of the sound image formed by the first and second sounds changes. By adjusting the volume ratio of the first and second sounds, the position of the sound image formed by the first and second sounds is adjusted, thereby achieving adjustment of the sound image position in the height direction, so that the sound image position is synchronized with the picture.
[0064] In one possible implementation, a first speaker emits a first sound at a first moment, and a second speaker emits a second sound corresponding to the first sound at a second moment. The first and second sounds are mixed in the user's viewing area; there is a time difference between the first and second moments. By controlling the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, the user can simultaneously receive the sounds emitted by the first and second speakers at a third moment. This results in more accurate sound image positioning, preventing any misalignment between the image and the sound image, thus achieving precise synchronization between the sound image and the image and improving the user experience.
[0065] In one possible implementation, when the spatial parameters of the application environment in which the display device is located change, the time difference between the first moment and the second moment changes, so as to ensure that the sound emitted by the first speaker and the second speaker arrives at the user's viewing area at the same time, so as to make the sound image positioning more accurate.
[0066] In one possible implementation, the sound-emitting direction of the first speaker is variable, and the first speaker can adjust the sound-emitting direction as needed so that the sound emitted by the first speaker can be accurately transmitted to the user's viewing area.
[0067] In one possible implementation, the sound emission direction of the first speaker can be varied when the spatial parameters of the application environment in which the display device is located change. By adjusting the sound emission direction of the first speaker through spatial parameters, automatic adjustment of the sound emission direction of the first speaker can be achieved, thereby improving the user experience.
[0068] In one possible implementation, the spatial parameters include at least one of a first distance, a second distance, and a third distance. The first distance is the distance between the display device and a first obstacle, the second distance is the distance between the display device and a second obstacle, and the third distance is the distance between the display device and the user. The display device can adjust the position of the user's viewing area according to the user's location, so that the user can have a good audiovisual experience no matter where they move. Attached Figure Description
[0069] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.
[0070] Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;
[0071] Figure 2 yes Figure 1 The diagram shows an exploded view of the display device from another angle.
[0072] Figure 3 yes Figure 1 The diagram shows the structure of the display device in the application environment.
[0073] Figure 4 This is a structural diagram of a display device based on related technologies located in an application environment;
[0074] Figure 5 yes Figure 3 A schematic diagram of another embodiment of the display device is shown;
[0075] Figure 6 yes Figure 3 A schematic diagram of the processor, first speaker, and second speaker of the display device shown.
[0076] Figure 7 yes Figure 6 A schematic diagram of the audio output processing procedure for the structure shown.
[0077] Figure 8 yes Figure 7A detailed schematic diagram of the audio output processing procedure is shown below.
[0078] Figure 9 yes Figure 6 A schematic diagram of another audio output processing procedure for the structure shown;
[0079] Figure 10 yes Figure 9 The diagram shows the control of the speaker's sound emission time in the audio output processing process.
[0080] Figure 11 yes Figure 10 A detailed schematic diagram of the audio output processing procedure is shown below.
[0081] Figure 12 yes Figure 6 A schematic diagram of another embodiment of the structure shown;
[0082] Figure 13 yes Figure 12 A schematic diagram of the audio output processing procedure for the structure shown.
[0083] Figure 14 yes Figure 1 A schematic diagram of another embodiment of the display device is shown;
[0084] Figure 15 This is a flowchart illustrating an audio output method for a display device provided in this embodiment. Detailed Implementation
[0085] The embodiments of this application are described below with reference to the accompanying drawings.
[0086] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation" and "connection" should be interpreted broadly. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. The directional terms mentioned in the embodiments of this application, such as "upper," "lower," "left," "right," "inner," "outer," "front," and "rear," are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application. "Multiple" refers to at least two.
[0087] It is understood that the specific embodiments described herein are for illustrative purposes and not for limiting the scope of the solutions. Furthermore, it should be noted that, for ease of description, only the parts relevant to the solutions are shown in the accompanying drawings.
[0088] The present application will now be described in detail with reference to the accompanying drawings and embodiments.
[0089] This application provides a display device, including but not limited to flat-panel TVs, computer monitors, conference displays, or automotive displays, etc., all equipped with speakers. This application uses a flat-panel TV as an example for specific description.
[0090] Please see Figure 1 and Figure 2 , Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application. Figure 2 yes Figure 1 The diagram shows an exploded view of the display device from another angle.
[0091] The display device 100 includes a housing 10, a display screen 20, a speaker 30, a motherboard 40, a processor 50, and a memory 60.
[0092] The display screen 20 is used to display images, videos, etc. The display screen 20 can also integrate touch functionality. The display screen 20 is mounted on the housing 10. The housing 10 may include a bezel 11 and a rear housing 12. The display screen 20 and the rear housing 12 are respectively mounted on opposite sides of the bezel 11, with the display screen 20 located on the user-facing side and the rear housing 12 located on the side away from the user. The display screen 20 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.
[0093] In this embodiment, in the external space of the display device 100, the space facing the display screen 20 is defined as the front of the display device 100, and the space facing the rear cover 12 is defined as the rear of the display device 100. The display device 100 includes a top 101, a bottom 102, and two sides 103 connected between the top 101 and the bottom 102 and disposed opposite to each other. The direction facing the top 101 of the display device 100 is defined as the upper direction of the display device 100, and the direction facing the bottom 102 of the display device 100 is defined as the lower direction of the display device 100.
[0094] The motherboard 40 is located inside the housing 10, and integrates the processor 50, memory 60, and other various circuit devices. The display screen 20 is coupled to the processor 50 to receive display signals sent by the processor 50. The processor 50 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.
[0095] The processor can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.
[0096] The processor 50 may also include internal memory for storing instructions and data. In some embodiments, the memory in the processor 50 may be a cache memory. This memory can store instructions or data that the processor 50 has used or that are used frequently. If the processor 50 needs to use the instruction or data, it can directly retrieve it from this memory. This avoids repeated accesses, reduces the waiting time of the processor 50, and thus improves the efficiency of the system.
[0097] In some embodiments, the processor 50 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The processor 50 can connect to modules such as touch sensors, audio modules, wireless communication modules, displays, and cameras through at least one of these interfaces.
[0098] The memory 60 can be used to store computer executable program code, which includes instructions. The memory 60 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the display device 100 (such as audio data, phonebook, etc.). Furthermore, the memory 60 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 50 executes various functional methods or data processing of the display device 100 by running instructions stored in the memory 60 and / or instructions stored in memory disposed in the processor, for example, causing the display screen 20 to display a target image.
[0099] The display device 100 can implement audio functions through an audio module, speakers, and a processor, such as music playback and sound playback. The audio module is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module can also be used for encoding and decoding audio signals. In some embodiments, the audio module can be located within the processor 50, or some functional modules of the audio module can be located within the processor 50, or some or all functional modules of the audio module can be located outside the processor 50.
[0100] A loudspeaker (e.g., loudspeaker 30), also called a "horn," is used to convert audio electrical signals into sound signals. The display device 100 can play music and other sounds through the loudspeaker.
[0101] The speaker 30 is located inside the housing 10 and integrated into the motherboard 40 on the side facing away from the display screen 20; that is, the speaker 30 is located on the rear side of the display screen 20. The rear side of the display screen 20 is the side facing away from the display surface of the display screen 20. The rear housing 12 is provided with a sound hole 121, through which the sound emitted by the speaker 30 is transmitted to the outside of the housing 10. The speaker 30 is coupled to the processor 50, which is used to execute instructions stored in the memory 60 and / or instructions stored in the memory located in the processor, so as to make the speaker 30 emit sound.
[0102] In this embodiment, the speaker 30 includes a first speaker 31 and a second speaker 32, both of which are fixed to the motherboard 40. Both the first speaker 31 and the second speaker 32 are coupled to the processor 50. The sound emission direction of the first speaker 31 is towards the rear-upper part of the display device 100, and the sound emission direction of the second speaker 32 is towards the front of the display device 100. It can be understood that the sound emission direction of the first speaker 31 is the initial propagation direction of the sound emitted by the first speaker 31, and the rear-upper part of the display device 100 is the direction between the rear of the display device 100 and the top of the display device.
[0103] Of course, in one scenario of other embodiments, the first speaker and the second speaker may also be fixed in other locations within the housing. The first speaker and the second speaker are generally located in different positions, and the directions in which they emit sound are different, resulting in different path lengths for the sound to reach the user. In another scenario of other embodiments, the speaker may include other speakers besides the first speaker and the second speaker.
[0104] For example, in some embodiments, the first speaker may be located at the top of the display device 100, and the sound emitted by the first speaker may be directed upwards. Specifically, the sound emitted by the first speaker may be directed directly above the display device 100, or the sound emitted by the first speaker may be directed forward and upward, etc. Furthermore, the first speaker and / or the second speaker may also be located on the side of the display device 100. Both the first speaker and / or the second speaker may comprise multiple arrays of speakers.
[0105] Please see Figure 3 , Figure 3 yes Figure 1 The diagram shows the structure of the display device 100 in the application environment.
[0106] In this embodiment, the display device 100 is positioned close to the wall 201, with the display screen 20 of the display device 100 facing away from the wall 201 and the top 101 of the display device 100 facing the ceiling 202. Sound emitted by the first speaker 31 is reflected by a first obstacle located behind the display device 100 to a second obstacle located above the display device 100, and then reflected by the second obstacle to the user viewing area in front of the display device 100. In other words, the first obstacle behind the display device 100 is the wall 201, the second obstacle above the display device 100 is the ceiling 202, and the area in front of the display device 100 is the user viewing area 203.
[0107] Of course, in other embodiments, the application environment of the display device 100 may be different. The first obstacle may be a structure other than the wall 201, such as a screen or reflector. The second obstacle may be a blocking structure such as a reflector.
[0108] like Figure 3 Specifically, the sound emitted by the first speaker 31 is reflected by the wall 201 located behind the display device 100, forming a mirror image of the first speaker 31, A, with the wall 201 as the reflector. The sound reflected by the wall 201 continues to be transmitted towards the ceiling 202 above the display device 100. After being reflected by the ceiling 202, it forms a mirror image of the first speaker 31, B, with the ceiling 202 as the reflector. After being reflected again by the ceiling 202, the sound is projected downwards from the ceiling 202 onto the user viewing area 203 in front of the display device 100, with the mirror image of the sound source B as the sound image. The location of the sound-emitting object perceived by a person through the sound is called the sound image.
[0109] It is understandable that, such as Figure 4 In related technologies, the sound-emitting direction of speaker 2 is directed towards the front and upper part of display device 1, so that the sound emitted by speaker 2 can be transmitted to ceiling 3 and reflected by ceiling 3 to reach user viewing area 4. Since the sound waves radiated by speaker 2 are directional, the sound waves propagating along the axial direction of speaker 2 have the strongest intensity, and the intensity gradually weakens as the off-axis angle increases. Part of the sound emitted by speaker 2 is reflected by ceiling 3 and reaches user viewing area 4; this part of the sound is called reflected sound S1. Another part is directly transmitted to user viewing area 4 in front of display device 1; this part of the sound is called direct sound S2. Because the axial direction of speaker 2 is directed towards the front and upper part of display device 1, the off-axis angle of direct sound S2 from the axial direction of speaker 2 is small, resulting in stronger direct sound S2. Direct sound S2 arrives at user viewing area 4 before reflected sound S1. Due to the Haas effect, human hearing has a preconceived notion and cannot distinguish the delayed arrival of reflected sound S1. Therefore, direct sound S2 weakens the localization effect of the sky sound image after reflected sound S1, reducing the user experience.
[0110] The first speaker 31 of this application directs its sound emission direction toward the rear and upper part of the display device 100, meaning its axial direction is also directed toward the rear and upper part of the display device 100. Because the axial direction of the first speaker 31 is directed toward the rear and upper part of the display device 100, most of the sound from the first speaker 31 is directed toward the wall 201, reflected by the wall 201, and then reflected by the ceiling 202 to reach the user viewing area 203. A small portion of the sound from the first speaker 31 deviates significantly from its axial direction and can directly reach the user viewing area 203 in front of the display device 100; however, this portion of the sound has a large off-axis angle from the main axis of the first speaker 31, resulting in weaker sound intensity. Therefore, the masking effect of the sound directly reaching the user viewing area 203 on the sound that has been reflected twice by the wall 201 and the ceiling 202 is weak, while the sound reflected by the ceiling 202 to reach the user viewing area 203 has a good sky-based sound image localization effect, improving the user's audiovisual experience.
[0111] Meanwhile, the sound emitted by the first speaker 31 is reflected by the wall 201 to the ceiling 202, and then reflected by the ceiling 202 and projected to the user viewing area 203. The sound image transmitted to the user viewing area 203 is the sound image located above the ceiling 202. In this way, the sound field range in the height direction formed by the first speaker 31 is not limited to the size of the display screen 20, so that the sound field in the height direction can cover the entire spatial height of the application environment, achieving the effect of sky sound image positioning. For example, the sound image of an aircraft engine can be located above the display screen 20 and played through the first speaker 31, so that the picture and sound positioning of the display screen 20 are consistent.
[0112] Please see Figure 2 and Figure 3 In this embodiment, the first speaker 31 is positioned close to the top 101 of the display device 100, and the sound hole 121 of the rear shell is correspondingly positioned to the first speaker 31. That is, the first speaker 31 is located below the top 101, so the sound emitted by the first speaker 31 towards the front of the display device 100 is blocked by the shell 10 of the display device 100, effectively reducing the sound transmitted directly from the first speaker 31 to the user's viewing area 203, making the positioning of the sky sound image more accurate.
[0113] Specifically, there are two first speakers 31. One first speaker 31 is disposed near one side 103 of the display device 100, and the other first speaker 31 is disposed near the other side 103, so as to play audio information of the left and right channels respectively. Of course, in other embodiments, the number of first speakers 31 may be one or more, and this application does not limit the number of first speakers 31.
[0114] In another embodiment, the first speaker 31 may also be located between the midpoint of the top 101 and bottom 102 of the display device 100 and the top 101. That is, the first speaker 31 may also be located at any position on the upper half of the display device 100, such as... Figure 5 As shown. In another implementation scenario of other embodiments, the first speaker 31 may also be located at the top 101 of the display device 100. Specifically, the position of the first speaker 31 is also related to the distance from the display device 100 to the wall 201 and the ceiling 202, and the angle between the sound output direction of the first speaker 31 and the horizontal direction.
[0115] like Figure 3 As shown, the sound emission direction of the first speaker 31 is at an angle of 35 to 45 degrees (inclusive) to the horizontal direction, which is perpendicular to the display surface of the screen 20. When the sound emission direction of the first speaker 31 is at an angle of 35 to 45 degrees to the horizontal direction, the display device 100 can be applied to various application environments with different spatial parameters. When applied to various application environments with different spatial parameters, the sound emitted by the first speaker 31 can be reflected sequentially by the wall 201 and ceiling 202 in different application environments, and finally reach the user's viewing area 203. Spatial parameters are a set of multiple different parameters, such as the distance from the display device 100 to the wall 201, the distance from the display device 100 to the ceiling 202, and the distance from the display device 100 to the user. In other words, the display device 100 can be applied to various application environments with different spatial parameters within a certain distance from the wall 201, a certain distance from the ceiling 202, and a certain distance from the user, ensuring the user's audiovisual experience.
[0116] Of course, in other embodiments, the sound output direction of the first speaker 31 can also be at an angle of 10 degrees to 80 degrees (including 10 degrees and 80 degrees) or other angles other than 10 degrees to 80 degrees with the horizontal direction, as long as it can ensure that the sound emitted by the first speaker is reflected by the wall and the ceiling in sequence and finally reaches the user's viewing area.
[0117] like Figure 1 and Figure 3 The second speaker 32 is positioned relative to the first speaker 31 near the bottom 102. The first sound emitted by the first speaker 31 and the second sound emitted by the second speaker 32 are mixed in the user's viewing area so that the user receives a combined sound formed by sounds emitted from speakers in different positions, thereby enhancing the stereo effect of the sound.
[0118] Specifically, in this embodiment, the second speaker 32 is located at the bottom 102 of the display device 100. There are two second speakers 32: one is positioned near one side 103 of the display device 100, and the other is positioned near the other side 103 of the display device 100, to play audio information for the left and right channels respectively. Of course, in other embodiments, the number of second speakers 32 can be one or more; this application does not limit the number of second speakers 32.
[0119] In one embodiment of other embodiments, the second speaker may also be located on the side of the display device. In another embodiment of other embodiments, the second speaker may be partially located at the bottom and partially located on the side of the display device. In yet another embodiment of other embodiments, the second speaker may be located in the middle of the display device. Alternatively, some of the second speakers may be located at the top of the display device, some at the bottom, and some in the middle. In yet another embodiment of other embodiments, the second speaker can generate sound by vibrating the display screen; that is, a portion of the display screen forms the second speaker through vibration, achieving a stereo effect without occupying internal space of the display device, and also helping to increase the screen-to-body ratio of the display device.
[0120] In this embodiment, the sound-emitting direction of the second speaker 32 is towards the front of the display device 100. That is, the sound-emitting direction of the second speaker is towards the user viewing area 203, and the second speaker 32 can be used to play sounds such as footsteps. The sound-emitting direction of the second speaker 32 towards the user viewing area 203 can be that the sound opening of the second speaker 32 is directly facing the user viewing area 203, or that the sound opening of the second speaker 32 is not facing the user viewing area 203, but is redirected to the user viewing area 203 by a sound diversion device. Of course, in other embodiments, the sound-emitting direction of the second speaker can also be towards the bottom of the display device.
[0121] Please see Figure 6 , Figure 6 yes Figure 3 The diagram shows the structure of the processor 50, the first speaker 31, and the second speaker 32 in the display device 100. The processor 50 includes an audio module, which may include functional modules such as an acquisition module, a rendering module, and a power amplifier module. The rendering module is coupled to the acquisition module and the power amplifier module, respectively. The power amplifier module includes a first power amplifier module and a second power amplifier module. The first power amplifier module is coupled to the first speaker 31, and the second power amplifier module is coupled to the second speaker 32.
[0122] In this embodiment, the processor 50 can adjust the position of the sound image formed by the first sound emitted by the first speaker 31 and the second sound emitted by the second speaker 32 corresponding to the first sound. Specifically, the processor 50 adjusts the position of the sound image formed by the first sound and the second sound using the following method:
[0123] Please refer to the following: Figure 3 , Figure 6 and Figure 7 , Figure 7 yes Figure 6 The diagram shows the audio output processing procedure of the structure shown.
[0124] The processor 50 adjusts the position of the sound image formed by the first sound emitted by the first speaker 31 and the second sound emitted by the second speaker 32 by controlling the ratio of the volume of the first sound emitted by the first speaker 31 to the volume of the second sound emitted by the second speaker 32. That is, when the volume ratio of the first sound and the second sound changes, the position of the sound image formed by the first sound and the second sound changes.
[0125] Specifically, the acquisition module acquires the image and audio information of the video content. The video content can be video content, games, real-time video, etc. Real-time video can be, for example, video calls, live video streaming, or video conferencing. First audio information and second audio information are extracted from the audio information, where the first audio information and second audio information correspond to the first speaker 31 and the second speaker 32, respectively. The first audio information and second audio information can correspond to the same sound content; for example, the sound content of the first audio information and second audio information can correspond to the same person saying "Hello."
[0126] The rendering module adjusts the gain of the first and second audio information. Specifically, the rendering module determines the sound image position of the audio information based on the image information, and adjusts the volume ratio of the first and second audio information according to the sound image position.
[0127] Then, the first audio information is sent to the first power amplifier module of the power amplifier module, and after being amplified by the first power amplifier module, it is transmitted to the first speaker 31. The second audio information is sent to the second power amplifier module of the power amplifier module, and after being amplified by the second power amplifier module, it is transmitted to the second speaker 32.
[0128] For example, when the sound image of a person's voice saying "hello" comes from below the display screen, the volume of the first audio signal can be lower than the volume of the second audio signal. The first and second audio signals are amplified by the first and second power amplifier modules respectively and then sent to the first and second speakers. This results in the volume of "hello" emitted by the first speaker being lower than the volume of "hello" emitted by the second speaker. When a user hears both the "hello" from the first and second speakers, they will perceive the sound image of "hello" as coming from below the display screen. Conversely, when the sound image of a person's voice saying "hello" comes from above the display screen, the volume of the first audio signal can be higher than the volume of the second audio signal. The first and second audio signals are amplified by the first and second power amplifier modules respectively and then sent to the first and second speakers. This results in the volume of "hello" emitted by the first speaker being higher than the volume of "hello" emitted by the second speaker. When a user hears both the "hello" from the first and second speakers, they will perceive the sound image of "hello" as coming from above the display screen.
[0129] By adjusting the ratio of the volume of the first sound emitted from the first speaker 31 to the volume of the second sound emitted from the second speaker 32, the position of the sound image in the height direction can be adjusted to synchronize the sound image position with the screen and achieve a good stereo effect. Here, the height direction refers to the direction from the top 101 to the bottom 102 of the display device 100. The sound image position is the position of the sound image formed by the first and second sounds.
[0130] It is understandable that, such as Figure 3 As shown, the position of the mirror sound source B of the first speaker 31 is the first position, and the position of the second speaker 32 is the second position. The processor 50 can adjust the volume ratio of the sounds emitted by the first speaker 31 and the second speaker 32, that is, adjust the volume ratio of the first sound and the second sound, so that the sound image position of the first sound and the second sound can be adjusted between the first position and the second position. For example, when the first speaker 31 is not producing sound and the second speaker 32 is producing sound, the sound image position is located at the second position. When the volume of the first speaker 31 and the second speaker 32 is the same, the sound image position is near the middle between the first position and the second position.
[0131] For example, if display screen 20 shows a bird flying from the bottom to the top of the display device, the sound image position of the audio corresponding to the bird's flight also moves from the bottom to the top. Correspondingly, when the sound image position is at the bottom, the first speaker does not emit sound, and the second speaker emits sound. As the sound image position moves towards the top, the first sound emitted by the first speaker gradually increases, and the second sound emitted by the second speaker gradually decreases, so that the sound image position formed by the first and second sounds is consistent with the bird's flight trajectory.
[0132] Specifically, such as Figure 8 The acquisition module acquires the image and audio information of the video content. It extracts first and second audio information from the audio information. The audio information includes first information and second information; the first information is the left channel audio information, and the second information is the right channel audio information. It extracts first and second sub-information from the first information, and third and fourth sub-information from the second information. The first and third sub-information form the first audio information, and the second and fourth sub-information form the second audio information.
[0133] The rendering module adjusts the gain of the volume of the first, second, third, and fourth sub-information. Specifically, the rendering module determines the sound image position of the audio information based on the image information, and adjusts the volume ratio of the first, second, third, and fourth sub-information according to the sound image position.
[0134] The first power amplifier module includes a first power amplifier and a second power amplifier, and the second power amplifier module includes a third power amplifier and a fourth power amplifier. Two first speakers 31 are designated as first speaker L (left first speaker) and first speaker R (right first speaker), and two second speakers 32 are designated as second speaker L (left second speaker) and second speaker R (right second speaker). The first sub-information, rendered by the rendering module, is sent to the first power amplifier, amplified, and then transmitted to the first speaker L. The third sub-information, rendered by the rendering module, is sent to the second power amplifier, amplified, and then transmitted to the first speaker R. The second sub-information, rendered by the rendering module, is sent to the third power amplifier, amplified, and then transmitted to the second speaker L. The fourth sub-information, rendered by the rendering module, is sent to the fourth power amplifier, amplified, and then transmitted to the second speaker R.
[0135] This application adjusts the volume ratio of the sounds emitted from the first speaker L, the first speaker R, the second speaker L, and the second speaker R, thereby adjusting the position of the sound image in three-dimensional space. This synchronizes the sound image position with the screen, achieving a realistic three-dimensional spatial sound field effect with excellent stereo sound. Please refer to... Figure 9 and Figure 10 , Figure 9 yes Figure 6 A schematic diagram of another audio output processing procedure for the structure shown; Figure 10 yes Figure 9 The diagram shows the control of the speaker's sound output time in the audio output processing.
[0136] In some embodiments, the processor is further configured to control the timing of the first and second speakers emitting sound. That is, the first and second speakers emit sound asynchronously. Specifically, the acquisition module acquires the image and audio information of the video content. The video content can be video content, games, live video, etc. Live video can be, for example, video calls, live video streaming, or video conferencing. First and second audio information are extracted from the audio information, where the first and second audio information correspond to the first and second speakers, respectively. The first and second audio information can correspond to the same sound content; for example, the sound content of the first and second audio information can correspond to the same person saying "hello."
[0137] The rendering module adjusts the gain of the first and second audio information volumes. Specifically, the rendering module determines the sound image position of the audio information based on the image information and adjusts the volume ratio of the first and second audio information accordingly. Simultaneously, the rendering module controls the transmission delay of the first and second audio information to the next module. Then, the first audio information is sent to the first power amplifier module, where it is amplified and transmitted to the first speaker. The first speaker, at the first moment T1 (e.g., ...),... Figure 10 The system emits a first sound and sends the second audio information to the second power amplifier module. After being amplified by the second power amplifier module, the second sound is transmitted to the second speaker, which then emits the second sound at the second time T2. There is a time difference between the first and second times. Δ T, the first moment is earlier than the second moment. Among them, in Figure 10 In the diagram, 10A represents the waveform of the sound emitted by the first speaker after receiving the first audio information at the first time T1, and 10B represents the waveform of the sound emitted by the second speaker after receiving the second audio information at the second time T2. The waveform relationship between the first and second audio information is similar to that between 10A and 10B. For example, the waveforms of the first and second audio information may also have a time difference.
[0138] For example, when the sound image of a person's voice saying "hello" originates from below the display screen, the volume of the first audio signal can be lower than the volume of the second audio signal. The first audio signal is sent to the first power amplifier module at the first moment, amplified by the first power module, and then sent to the first speaker so that the first speaker emits "hello" at the first moment (a 10A waveform can represent the first speaker emitting "hello"). The second audio signal is sent to the second power amplifier module at the second moment, amplified by the second power module, and then sent to the second speaker so that the second speaker emits "hello" at the second moment (a 10B waveform can represent the second speaker emitting "hello"). This results in the volume of the "hello" emitted by the first speaker being lower than the volume of the "hello" emitted by the second speaker, and both the "hello" from the first and second speakers reach the user simultaneously. When the user hears both the "hello" from the first and second speakers, they will perceive that the sound image of "hello" originates from below the display screen.
[0139] When the sound image of a person's voice saying "Hello" originates from above the display screen, the volume of the first audio signal can be greater than the volume of the second audio signal. The first audio signal is sent to the first amplifier module at the first moment, amplified by the first power module, and then sent to the first speaker so that the first speaker emits "Hello" at the first moment. The second audio signal is sent to the second amplifier module at the second moment, amplified by the second power module, and then sent to the second speaker so that the second speaker emits "Hello" at the second moment. This results in the volume of the "Hello" emitted by the first speaker being greater than the volume of the "Hello" emitted by the second speaker, and the "Hello" emitted by the first and second speakers reaches the user simultaneously or almost simultaneously. When the user hears both the "Hello" from the first speaker and the "Hello" from the second speaker, they will perceive that the sound image of "Hello" originates from above the display screen.
[0140] This embodiment adjusts the ratio of the volume of the first sound emitted from the first speaker to the volume of the second sound emitted from the second speaker, thereby adjusting the height of the sound image position to synchronize it with the screen. Simultaneously, the first speaker emits sound at the first moment T1, and the second speaker emits sound at the second moment T2. This allows the user to receive the first and second sounds simultaneously or almost simultaneously at the third moment, resulting in more accurate sound image positioning and preventing any misalignment between the screen and the sound image. This precise synchronization between the sound image and the screen provides a better stereo effect and enhances the user experience.
[0141] It is understandable that the third moment can refer to a specific moment or a very small time range. That is to say, the user can receive the first sound and the second sound simultaneously at exactly the third moment, or the user can receive the first sound and then receive the second sound after a certain time interval, but the user cannot perceive this time interval. In other words, this time interval will not cause any deviation in the user's positioning of the sound image.
[0142] It is understandable that there is a time difference. Δ T = (D1 - D2) / V, where D1 is the transmission path of the first sound emitted by the first speaker from the first speaker to the user's viewing area, D2 is the transmission path of the second sound emitted by the second speaker from the second speaker to the user's viewing area, and V = 340 m / s (speed of sound in air). Specifically, the time difference... Δ The value of T can range from 1ms to 50ms, such as 2ms, 5ms or 10ms, which allows for precise adjustment of stereo sound.
[0143] In some embodiments, when the position of the sound image changes, the time difference Δ T can also be changed to enhance the positional information of the sound image. For example, when the sound image of a person saying "hello" moves from the bottom of the screen to the top of the screen, and the sound image is now located at the bottom of the screen, the time difference is... Δ When the audio-visual position is above the display at T1, the time difference is... Δ T2, time difference Δ T2 is less than the time difference Δ T1. In other words, as the sound image moves from the bottom of the screen to the top of the screen, the "hello" emitted by the first speaker will reach the user and be received by the user before the "hello" emitted by the second speaker, allowing the user to clearly feel the movement of the sound image.
[0144] Specifically, such as Figure 11 The acquisition module acquires the image and audio information of the video content. It extracts first and second audio information from the audio information. The audio information includes first information and second information; the first information is the left channel audio information, and the second information is the right channel audio information. It extracts first and second sub-information from the first information, and third and fourth sub-information from the second information. The first and third sub-information form the first audio information, and the second and fourth sub-information form the second audio information.
[0145] The rendering module adjusts the gain of the volume of the first, second, third, and fourth sub-information messages. Specifically, the rendering module determines the sound image position of the audio information based on the image information and adjusts the volume ratio of the first, second, third, and fourth sub-information messages accordingly. Simultaneously, the rendering module also controls the transmission delay of the first, second, third, and fourth sub-information messages to the next module.
[0146] The first power amplifier module includes a first power amplifier and a second power amplifier, and the second power amplifier module includes a third power amplifier and a fourth power amplifier. The two first speakers are designated as first speaker L (left first speaker) and first speaker R (right first speaker), and the two second speakers are designated as second speaker L (left second speaker) and second speaker R (right second speaker). The first sub-information, rendered by the rendering module, is sent to the first power amplifier, amplified, and then transmitted to the first speaker L. The third sub-information, rendered by the rendering module, is sent to the second power amplifier, amplified, and then transmitted to the first speaker R. The first speakers L and R then emit sound at time T1. The second sub-information, rendered by the rendering module, is sent to the third power amplifier, amplified, and then transmitted to the second speaker L. The fourth sub-information, rendered by the rendering module, is sent to the fourth power amplifier, amplified, and then transmitted to the second speaker R. The second speakers L and R then emit sound at time T2. There is a time difference between the first and second times.
[0147] This embodiment adjusts the volume ratio of the sounds emitted from the first speaker L, the first speaker R, the second speaker L, and the second speaker R to adjust the sound image position, thus synchronizing the sound image position with the screen. Simultaneously, the first speaker L and the first speaker R emit sound at the first time T1, and the second speaker L and the second speaker R emit sound at the second time T2. This allows the user to simultaneously receive the sounds emitted by the first speaker L, the first speaker R, the second speaker L, and the second speaker R at the third time. The sound image position is more accurately located, preventing any misalignment between the screen and the sound image, achieving precise synchronization between the sound image and the screen, resulting in a better stereo effect and improved user experience.
[0148] Of course, in some embodiments, the processor can also control the timing of the first and second speakers, that is, the first and second speakers emit sound asynchronously, so that the first sound emitted by the first speaker and the second sound emitted by the second speaker reach the user's viewing area at the same time and are received by the user at the same time, resulting in a better stereo effect and improved user experience.
[0149] In some embodiments, please refer to Figure 12 and Figure 13 , Figure 12 yes Figure 6 A schematic diagram of another embodiment of the structure shown. Figure 13 yes Figure 12 The diagram shows the audio output processing procedure of the structure shown.
[0150] The processor 50 includes an audio module, which may include functional modules such as an acquisition module, a rendering module, a mixing module, and a power amplifier module. The acquisition module, rendering module, mixing module, and power amplifier module are coupled sequentially, and the power amplifier module is coupled to both the first speaker 31 and the second speaker 32. The audio information in the video content is processed by the processor 50 using an upmixing algorithm.
[0151] Specifically, the acquisition module acquires the image and audio information of the video content. The video content can be video content, games, live video, etc. Live video can be, for example, video calls, live video streaming, or video conferencing. The module extracts first and second audio information from the audio information. The audio information includes first information (left channel audio information) and second information (right channel audio information).
[0152] After processing the first and second information using an upmixing algorithm that extracts high-level content signals, the first information generates a left high-level channel signal and a left main channel signal. The second information is divided into a right high-level channel signal and a right main channel signal. The left high-level channel signal is then divided into a first signal and a second signal, the right high-level channel signal into a third signal and a fourth signal, the left main channel signal into a fifth signal and a sixth signal, and the right main channel signal into a seventh signal and an eighth signal. The first, third, fifth, and seventh signals form the first audio information, while the second, fourth, sixth, and eighth signals form the second audio information.
[0153] The rendering module adjusts the gain of the volume of the first, second, third, fourth, fifth, sixth, seventh, and eighth signals. Specifically, the rendering module determines the sound image position of the audio information based on the image information and adjusts the volume ratio of the first, second, third, fourth, fifth, sixth, seventh, and eighth signals accordingly. Simultaneously, the rendering module also controls the transmission delay of the first, second, third, fourth, fifth, sixth, seventh, and eighth signals to a single module.
[0154] The mixing module includes a first module, a second module, a third module, and a fourth module. The first module mixes the first and fifth signals rendered by the rendering module to obtain the first mix. The second module mixes the third and seventh signals rendered by the rendering module to obtain the second mix. The third module mixes the second and sixth signals rendered by the rendering module to obtain the third mix. The fourth module mixes the fourth and eighth signals rendered by the rendering module to obtain the fourth mix.
[0155] The power amplifier module includes a first power amplifier module and a second power amplifier module. The first power amplifier module includes a first power amplifier and a second power amplifier module, and the second power amplifier module includes a third power amplifier and a fourth power amplifier module. Two first speakers 31 are designated as first speaker L (left first speaker) and first speaker R (right first speaker), and two second speakers 32 are designated as second speaker L (left second speaker) and second speaker R (right second speaker). A first mix is sent to the first power amplifier, amplified, and then transmitted to the first speaker L. A second mix is sent to the second power amplifier, amplified, and then transmitted to the first speaker R. Both first speakers L and R emit sound at the first moment. A third mix is sent to the third power amplifier, amplified, and then transmitted to the second speaker L. A fourth mix is sent to the fourth power amplifier, amplified, and then transmitted to the second speaker R. Both second speakers L and R emit sound at the second moment. There is a time difference between the first and second moments.
[0156] This application processes the audio information in the video content through an upmixing algorithm that extracts the height content signal, effectively achieving the sound image localization of the left height channel signal, right height channel signal, left main channel signal, and right main channel signal at specific positions in the height direction. This allows the sound image localization of various sounds in the height direction to be adjusted as needed, achieving unified localization of various sounds and images. For example, the sound image of an airplane engine can be located at the top of the screen, the sound image of dialogue can be located in the middle of the screen, and the sound image of footsteps can be located at the bottom of the screen.
[0157] Please see Figure 14 , Figure 14 yes Figure 1 A schematic diagram of another embodiment of the display device 100 shown.
[0158] This embodiment and Figure 1The embodiments shown are largely the same, except that the display device 100 in this embodiment also includes a distance detector 70. The distance detector 70 is located inside the housing 10 and coupled to the processor 50. Of course, the distance detector 70 can also be located outside the housing 10. The distance detector 70 is used to detect the spatial parameters of the application environment in which the display device 100 is located. The spatial parameters include various parameters, such as a first distance between the display device 100 and the wall, a second distance between the display device 100 and the ceiling, and a third distance between the display device 100 and the user.
[0159] The sound emission direction of the first speaker 31 can be adjusted. Specifically, the first speaker 31 can adjust its sound emission direction according to spatial parameters. For example, the display device 100 may include a driving component, and the first speaker 31 is mounted on or cooperates with the driving component. The driving component is coupled to a processor, which drives the driving component to adjust the sound emission direction of the first speaker 31 according to the spatial parameters obtained by the distance detector 70. That is, when the spatial parameters of the application environment in which the display device is located change, the sound emission direction of the first speaker 31 can be variable, so that the display device 100 can be adapted to different application environments. Furthermore, by adjusting the sound emission direction of the first speaker according to the application environment, automatic adjustment of the sound emission direction of the first speaker is achieved, ensuring that the first sound emitted by the first speaker can be accurately transmitted to the user's viewing area, thus improving the user experience. The display device 100 can also adjust the position of the user's viewing area according to the user's location, so that the user can have a good audiovisual experience no matter where they move.
[0160] Of course, in one implementation scenario of other embodiments, the spatial parameters also include the distance between the display device 100 and other obstacles. Alternatively, the spatial parameters include at least one of a first distance, a second distance, and a third distance. In yet another implementation scenario of other embodiments, the sound emission direction of the first speaker 31 can also be manually adjusted.
[0161] It is understood that the display device 100 in this embodiment can adjust the sound emission direction of the first speaker 31 according to the application environment of the display device 100. When the display device 100 is used for the first time, or when the display device 100 is moved to a new application environment, the display device 100 will detect the spatial parameters of the application environment through the distance detector 70. The display device 100 adjusts the sound emission direction of the first speaker 31 according to the spatial parameters, so that the first sound emitted by the first speaker 31 can be accurately transmitted to the user's viewing area after reflection in different application environments, thereby improving the user's audiovisual experience.
[0162] In some embodiments, the display device 100 may further include a sensing sensor, i.e., a sensor that senses whether the display device 100 has been moved or whether the position of the display device 100 has changed. For example, the sensing sensor may be a gyroscope, accelerometer, etc. When the sensing sensor detects a change in the position of the display device 100, it can trigger the distance detector 70 to detect the spatial parameters of the application environment, so that the first speaker 31 adjusts its sound emission direction according to the spatial parameters. Thus, whenever the position of the display device 100 changes, the distance detector 70 will acquire the spatial parameters of the application environment, so that the first speaker 31 adjusts its sound emission direction according to the spatial parameters, ensuring the user's audiovisual experience at all times.
[0163] It is understandable that the sensing sensor can record information about the movement of the display device 100 even when the display device 100 is powered off. When the display device 100 is powered on, the sensing sensor triggers the distance detector 70 to detect the spatial parameters of the application environment, so as to adjust the sound emission direction of the first speaker 31 according to the spatial parameters. Even if the display device 100 is moved after power failure, the sound emission direction of the first speaker 31 will still be adjusted according to the application environment when the display device 100 is turned on again, so as to ensure the user's audio-visual experience.
[0164] In this embodiment, the distance detector 70 includes a radar capable of emitting and receiving ultrasonic waves. The spatial parameters of the application environment measured by ultrasonic waves are more accurate than data obtained by other methods. Of course, in another implementation scenario, the distance detector 70 may also include a microphone. That is, the display device 100 emits sound, which is reflected back to the display device 100 after passing through an obstacle and is then received by the microphone. The distance between the display device 100 and the obstacle is obtained by calculating the time difference between the emission and reception of the sound.
[0165] In another embodiment, the distance detector 70 includes a camera, which takes pictures to identify the distance between the display device 100 and obstacles. The obstacles can be walls, ceilings, or users, etc. In yet another embodiment, the distance detector 70 may further include at least two of radar, a microphone, and a camera, employing different ranging methods for different obstacles to obtain more accurate spatial parameters.
[0166] In this embodiment, the distance detector 70 is coupled to the processor 50. The distance detector 70 sends instructions to the processor 50. These instructions can be pulse signals or analog signals including spatial parameter information. In response to these instructions, the time difference between the first and second moments is adjusted. Specifically, the processor 50 adjusts the time difference between the first and second moments based on the information carried in the instructions, such as the first distance, the second distance, and the third distance. That is, when the spatial parameters of the application environment in which the display device 100 is located change, the time difference between the first and second moments changes to ensure that the sounds emitted by the first speaker 31 and the second speaker 32 arrive at the user's viewing area simultaneously, thus making the sound image positioning more accurate. Of course, in other embodiments, the distance detector 70 can also determine the time difference between the first and second moments based on the difference between the paths of the sounds emitted by the first speaker 31 and the second speaker 32 arriving at the user's viewing area.
[0167] In other embodiments, the display device may further include a user input interface, which can be an application software on a mobile phone that interacts with the display device, or a settings window of the display device. The user enters spatial parameters such as a first distance, a second distance, or a third distance through the user input interface, and the first speaker adjusts its sound emission direction based on the data entered by the user. This method is less costly than obtaining spatial parameters through a distance detector.
[0168] Please see Figure 15 , Figure 15 This is a flowchart illustrating an audio output method for a display device 100 provided in this embodiment. This audio output method is applied to, for example... Figure 1 The display device 100 shown. The audio output method includes the following steps S110 to S130.
[0169] S110: Acquire audio information.
[0170] Specifically, such as Figure 8 The system acquires video and audio information from the image content via an acquisition module. The image content can be video content, games, live video, etc. Live video can be, for example, video calls, live video streaming, or video conferencing. The audio information includes first information and second information; the first information is the left channel audio information, and the second information is the right channel audio information.
[0171] S120: Extract the first audio information and the second audio information from the audio information.
[0172] Specifically, such as Figure 8The acquisition module extracts first sub-information and second sub-information from the first information, and extracts third sub-information and fourth sub-information from the second information. The first sub-information and third sub-information form the first audio information, and the second sub-information and fourth sub-information form the second audio information. The first audio information and the second audio information correspond to the first speaker and the second speaker, respectively. The first audio information and the second audio information can correspond to the same sound content. For example, the sound content of the first audio information and the second audio information can correspond to the same person saying "hello".
[0173] S130: Output the first audio information through the first speaker 31 and output the second audio information through the second speaker 32.
[0174] Specifically, such as Figure 3 and Figure 8 First, the first audio information and the second audio information are processed to adjust the position of the sound image formed by the first sound emitted by the first speaker 31 and the second sound emitted by the second speaker 32. Processing the first audio information and processing the second audio information includes adjusting the volume ratio of the first audio information and the second audio information.
[0175] For example, the rendering module adjusts the gain of the volume of the first, second, third, and fourth sub-information. Specifically, the rendering module determines the sound image position of the audio information based on the image information, and adjusts the volume ratio of the first, second, third, and fourth sub-information according to the sound image position.
[0176] Then, the first sub-information rendered by the rendering module is sent to the first power amplifier, amplified by the first power amplifier, and then transmitted to the first speaker L (left first speaker). The third sub-information rendered by the rendering module is sent to the second power amplifier, amplified by the second power amplifier, and then transmitted to the first speaker R (right first speaker). The second sub-information rendered by the rendering module is sent to the third power amplifier, amplified by the third power amplifier, and then transmitted to the second speaker L (left second speaker). The fourth sub-information rendered by the rendering module is sent to the fourth power amplifier, amplified by the fourth power amplifier, and then transmitted to the second speaker R (right second speaker).
[0177] This audio output method adjusts the volume ratio of the sounds emitted from the first speaker L, the first speaker R, the second speaker L, and the second speaker R to adjust the position of the sound image in three-dimensional space, thus synchronizing the sound image position with the screen and achieving a realistic three-dimensional spatial sound field effect. Simultaneously, by directing the sound output direction of the first speaker towards the rear and upper part of the display device, this application achieves good sky sound image positioning and stereo effect for the sound reflected from the ceiling to the user's viewing area, enhancing the user's audiovisual experience.
[0178] Of course, in one implementation scenario of other embodiments, processing the first audio information and the second audio information may further include controlling the first speaker 31 to emit sound at a first moment, controlling the second speaker 32 to emit sound at a second moment, and the user simultaneously receiving the sound from the first speaker 31 and the sound from the second speaker 32 at a third moment. There is a time difference between the first moment and the second moment, with the first moment being earlier than the second moment, so that the first speaker receives the first audio information, and the second speaker receives the second audio information corresponding to the first audio information. The playback times of the first audio information and the second audio information are not synchronized. Specifically, as shown... Figure 11 While adjusting the volume ratios of the first, second, third, and fourth sub-information, the rendering module also controls the transmission delay of the first, second, third, and fourth sub-information to the next module.
[0179] The first sub-information, rendered by the rendering module, is sent to the first power amplifier, amplified, and then transmitted to the first speaker L. The third sub-information, rendered by the rendering module, is sent to the second power amplifier, amplified, and then transmitted to the first speaker R. Both speakers L and R emit sound at the first moment. The second sub-information, rendered by the rendering module, is sent to the third power amplifier, amplified, and then transmitted to the second speaker L. The fourth sub-information, rendered by the rendering module, is sent to the fourth power amplifier, amplified, and then transmitted to the second speaker R. Both speakers L and R emit sound at the second moment. There is a time difference between the first and second moments.
[0180] This implementation adjusts the volume ratio of the sounds emitted from the first speaker L, first speaker R, second speaker L, and second speaker R to adjust the sound image position, thus synchronizing the sound image position with the screen. Simultaneously, by controlling the first speaker L and first speaker R to emit sound at the first moment, and the second speaker L and second speaker R to emit sound at the second moment—that is, the first speaker receives the first audio information and emits the first sound at the first moment, and the second speaker receives the second audio information and emits the corresponding second sound at the second moment—the user can simultaneously receive the sounds emitted by the first speaker L, first speaker R, second speaker L, and second speaker R at the third moment. This results in more accurate sound image positioning, preventing any misalignment between the screen and sound image positions, achieving precise synchronization between the sound image position and the screen, providing a better stereo effect, and improving the user experience.
[0181] Of course, in other embodiments, the audio output method may also control only the first speaker to emit sound at the first moment and the second speaker to emit sound at the second moment, so that the user can receive the sound emitted by the first speaker and the second speaker at the third moment, resulting in a good stereo effect and improving the user experience.
[0182] In another implementation scenario of other embodiments, such as Figure 12 The audio output method can also process the first and second information using an upmixing algorithm to extract the height content signal, generating left height channel signal, right height channel signal, left main channel signal, and right main channel signal. Then, the left height channel signal undergoes specific gain, delay, mixing, and power amplification processing before being transmitted to the first speaker L and the second speaker L, respectively, achieving sound image localization of the left height channel signal content at a specific position in the height direction. Similarly, the right height channel signal, left main channel signal, and right main channel signal achieve sound image localization at a specific position in the height direction in the same way, which will not be elaborated further.
[0183] This implementation scenario effectively achieves the sound image localization of the left and right height channel signals, left main channel signal, and right main channel signal at specific positions in the height direction by processing the audio information in the video content through an upmixing algorithm that extracts the height content signal. This allows the sound image localization of various sounds in the height direction to be adjusted as needed, achieving unified localization of various sounds and images. For example, the sound image of an airplane engine can be located at the top of the screen, the sound image of dialogue can be located in the middle of the screen, and the sound image of footsteps can be located at the bottom of the screen.
[0184] In other embodiments, the audio output method may also obtain first audio information from audio information alone and output the first audio information through a first speaker.
[0185] In other embodiments, the audio output method can also be applied to Figure 14 The display device 100 is shown. The audio output method further includes detecting the application environment of the display device, acquiring spatial parameters of the application environment, and changing the sound emission direction of the first speaker 31 in response to changes in the spatial parameters. Specifically, the spatial parameters of the application environment in which the display device 100 is located are detected by the distance detector 70. The spatial parameters include multiple parameters, such as a first distance between the display device 100 and the wall, a second distance between the display device 100 and the ceiling, and a third distance between the display device and the user. The processor adjusts the sound emission direction of the first speaker 31 in response to two or more of the spatial parameters. Specifically, the processor can adjust the sound emission direction of the first speaker 31 by controlling the driving components so that the display device 100 can be adapted to a variety of different application environments.
[0186] It is understood that the audio output method in this embodiment can adjust the sound emission direction of the first speaker 31 according to the application environment of the display device 100. When the display device 100 is used for the first time, or when the display device 100 is moved to a new application environment, the display device 100 will detect the spatial parameters of the application environment through the distance detector 70. Then, the sound emission direction of the first speaker 31 is adjusted according to the spatial parameters so that the display device 100 can ensure that the first sound emitted by the first speaker 31 is accurately reflected and placed in the user's viewing area in different application environments, thereby improving the user's audiovisual experience.
[0187] Of course, in some embodiments, the spatial parameters of the electronic device's application environment can also be manually input by the user. For example, the user can input them through the user input field of the display device. The user input field can be an application software on a mobile phone that interacts with the display device, or it can be the settings window of the display device. The user fills in spatial parameters such as a first distance, a second distance, or a third distance through the user input field, and the processor responds to the spatial parameters input by the user and adjusts the sound emission direction of the first speaker according to the data entered by the user. This method is less costly than obtaining spatial parameters through a distance detector.
[0188] In some embodiments, the audio output method can also sense the movement state of the display device 100 at all times. The movement state includes being moved and the position changing. When the position of the display device 100 changes, the distance detector 70 is triggered to detect the spatial parameters of the application environment. The sound emission direction of the first speaker 31 is adjusted according to the spatial parameters. Thus, as long as the position of the display device 100 changes, the distance detector 70 will obtain the spatial parameters of the application environment so that the first speaker 31 can adjust the sound emission direction according to the spatial parameters, thus ensuring the user's audio-visual experience at all times.
[0189] In some embodiments, the audio output method further includes a change in the time difference between a first moment and a second moment in response to changes in spatial parameters. Specifically, the processor can adjust the time difference between the first moment and the second moment based on spatial parameters, such as a first distance, a second distance, and a third distance, to ensure that the sounds emitted by the first speaker and the second speaker arrive at the user's viewing area simultaneously, thereby improving the accuracy of sound image localization. Of course, in other embodiments, the time difference between the first moment and the second moment can also be obtained based on the path difference between the path of the first sound emitted by the first speaker to the user's area and the path of the second sound emitted by the second speaker to the user's area.
[0190] It can be understood that the components that perform each step of the audio output method are not limited to the components described above, but can be any component capable of performing the above method.
[0191] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other.
[0192] The above are merely some embodiments and implementation methods of this application. The scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A display device, characterized by comprising: The display device comprises a display screen, a first loudspeaker and a second loudspeaker, the first loudspeaker is arranged at the back side of the display screen, and the sound emission direction of the first loudspeaker is towards the upper back side of the display device; The sound emission direction of the second loudspeaker is towards the front side of the display device or towards the lower side of the display device; The first loudspeaker and the second loudspeaker emit sound asynchronously; The display device comprises a top portion and a bottom portion, the first loudspeaker is arranged at the top portion, or the first loudspeaker is arranged between the midpoint between the top portion and the bottom portion and the top portion; The sound emission direction of the first loudspeaker is 10-80 degrees to the horizontal direction; The sound emitted by the first loudspeaker is reflected by a first barrier arranged at the back side of the display device to a second barrier arranged at the upper side of the display device, and is reflected by the second barrier to a user viewing area arranged at the front side of the display device; When the spatial parameters of the application environment in which the display device is arranged change, the sound emission direction of the first loudspeaker is changeable; The spatial parameters comprise at least one of a first distance, a second distance and a third distance, the first distance is the distance between the display device and the first barrier, the second distance is the distance between the display device and the second barrier, and the third distance is the distance between the display device and the user.
2. The display device of claim 1, wherein, The first loudspeaker emits a first sound at a first time, the second loudspeaker emits a second sound corresponding to the first sound at a second time, and the first sound and the second sound are mixed in the user viewing area; wherein the first time and the second time have a time difference.
3. The display device of claim 2, wherein, When the spatial parameters of the application environment in which the display device is arranged change, the time difference between the first time and the second time changes.
4. The display device of claim 2, wherein, When the volume ratio of the first sound and the second sound changes, the position of the sound image formed by the first sound and the second sound changes.
5. The display device of claim 3, wherein, The display device further comprises a processor, the processor is coupled with the first loudspeaker and the second loudspeaker, and the processor is configured to control the first loudspeaker to emit the first sound at the first time and control the second loudspeaker to emit the second sound at the second time.
6. The display device of claim 5, wherein, The processor is further configured to control the volume ratio of the first sound emitted by the first loudspeaker and the second sound emitted by the second loudspeaker.
7. The display device of claim 6, wherein, The display device further comprises a distance detector, the distance detector is configured to detect the application environment of the display device, acquire the spatial parameters of the application environment, and change the sound emission direction of the first loudspeaker in response to the change of the spatial parameters.
8. The display device of claim 7, wherein, The distance detector is coupled with the processor, the distance detector sends an instruction to the processor, and the time difference between the first time and the second time changes in response to the instruction.
9. The display device of claim 1, wherein, The second loudspeaker is arranged close to the bottom portion relative to the first loudspeaker. 10.An audio output method of a display device, the method comprising: The display device includes a display screen, a first speaker and a second speaker, the first speaker sounds to the upper rear of the display device, the sound direction of the second speaker is towards the front of the display device or towards the lower of the display device, the display device includes a top and a bottom, the first speaker is located at the top, or the first speaker is located between the midpoint between the top and the bottom and the top, the sound direction of the first speaker is 10-80 degrees from the horizontal direction, the sound emitted by the first speaker is reflected to the second obstacle located above the display device through the first obstacle located behind the display device, and reflected to the user viewing area in front of the display device through the second obstacle, the audio output method comprises: The first speaker receives first audio information, and the second speaker receives second audio information corresponding to the first audio information, the playing time of the first audio information and the second audio information is not synchronized; Detect the application environment of the display device and obtain the spatial parameters of the application environment; In response to the change of the spatial parameters, the sound direction of the first speaker changes; The spatial parameters include at least one of the first distance, the second distance and the third distance, the first distance is the distance between the display device and the first obstacle, the second distance is the distance between the display device and the second obstacle, and the third distance is the distance between the display device and the user.
11. The audio output method of claim 10, wherein, The audio output method includes that the first speaker emits first sound at a first time after receiving the first audio information, the second speaker emits second sound corresponding to the first sound at a second time after receiving the second audio information, and the first sound and the second sound are mixed in the user viewing area; wherein, the first time and the second time have a time difference.
12. The audio output method of claim 11, wherein, When the volume ratio of the first sound and the second sound changes, the position of the sound image formed by the first sound and the second sound changes.
13. The audio output method of claim 11, wherein, The audio output method further comprises: Detect the application environment of the display device and obtain the spatial parameters of the application environment; In response to the change of the spatial parameters, the time difference between the first time and the second time changes.
14. A display device, characterized by The display device includes a display screen, a first speaker and a second speaker, the first speaker is arranged on the rear side of the display screen, and the sound direction of the first speaker is towards the upper rear of the display device; The sound direction of the second speaker is different from that of the first speaker; The display device includes a top and a bottom, the first speaker is located at the top, or the first speaker is located between the midpoint between the top and the bottom and the top; The sound direction of the first speaker is 10-80 degrees from the horizontal direction; The sound emitted by the first speaker is reflected to the second obstacle located above the display device through the first obstacle located behind the display device, and reflected to the user viewing area in front of the display device through the second obstacle; The sound emission direction of the first loudspeaker is variable when a spatial parameter of an application environment in which the display device is located changes; The spatial parameter includes at least one of a first distance, a second distance and a third distance, the first distance being a distance between the display device and the first obstacle, the second distance being a distance between the display device and the second obstacle, and the third distance being a distance between the display device and the user.
Citation Information
Patent Citations
Audio player apparatus and its control method
US20090196440A1
Cited By
Display device and audio output method therefor
WO2022218195A1