Display device and audio processing parameter configuration method
By introducing an audio processing chip and an independent digital power amplifier into the TV, personalized sound effects and sound quality control are achieved for each channel, solving the problems of SoC resource limitations and channel crosstalk, and improving the TV's audio processing capabilities and sound performance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HISENSE VISUAL TECH CO LTD
- Filing Date
- 2026-01-22
- Publication Date
- 2026-05-01
AI Technical Summary
The TV's system-on-chip (SoC) has limited audio processing resources and cannot efficiently run the 5.1.2 multi-channel audio rendering algorithm, resulting in insufficient channel separation, inconsistent sound effects, and failure to meet the needs of a high-end audio experience. Furthermore, the integrated amplifier causes channel crosstalk and distortion.
By using an audio processing chip to free up SoC resources, multiple independent digital power amplifiers drive each channel, and personalized sound effect parameters and sound quality control configurations are applied to each channel to compensate for hardware differences and improve acoustic performance.
It achieves high-quality multi-channel audio processing, eliminates channel crosstalk, enhances auditory immersion and sound clarity, adapts to different auditory preferences in different scenarios, and protects the security of hardware devices.
Smart Images

Figure CN121967807A_ABST
Abstract
Description
A display device and a method for configuring audio processing parameters Technical Field
[0001] This application relates to the field of display device technology, and in particular to a display device and a method for configuring audio processing parameters. Background Technology
[0002] With the popularization of ultra-high-definition display technology and the explosive growth in demand for immersive audio-visual entertainment, televisions have transformed from simple audio-visual terminals into home entertainment centers. Users have increasingly demanding requirements for audio-visual experiences, not only pursuing 4K / 8K visual resolution but also seeking multi-dimensional immersive audio experiences comparable to cinemas. Against this backdrop, support for Dolby Atmos and other 5.1.2 multi-channel audio has become a technological focus for high-end television products.
[0003] Multi-channel decoding and sound rendering in televisions heavily rely on the audio processing unit built into their System-on-Chips (SoCs). However, the computing resources allocated to audio processing by the SoC are very limited. This prevents it from efficiently and effectively running the complex rendering algorithms required for 5.1.2 multi-channel audio, failing to meet the demands of a high-end audio experience. Furthermore, televisions use a single or highly integrated power amplifier to drive all speaker units. When one channel requires high power output, it momentarily lowers the supply voltage, causing compression and distortion in all other channels. This compromises the high channel separation necessary for a 5.1.2 system, making the sound, which should be precisely positioned, muddy and unclear. Additionally, all channels in a television receive globally uniform processing parameters, failing to compensate for the performance differences between individual speaker units. This results in unbalanced volume and inconsistent timbre across channels, preventing the 5.1.2 true multi-channel system from reaching its full potential. Summary of the Invention
[0004] Some embodiments of this application provide a display device and an audio processing parameter configuration method. By using an audio processing chip, high-performance audio processing is freed from the resource-constrained SoC. By independently driving and optimizing multiple digital power amplifiers, channel crosstalk is fundamentally eliminated. By individually configuring the sound effect parameters and sound quality control parameters of each channel, the differences in the hardware units themselves are compensated, thereby improving acoustic performance and sound effect expression.
[0005] In a first aspect, some embodiments of this application provide a display device, including: a display; an audio processing chip for supporting sound effect processing of multiple audio data corresponding to multiple channels; multiple digital power amplifiers, each corresponding to a different channel, the digital power amplifiers being used to perform sound quality control processing on the audio data of the corresponding channel output by the audio processing chip; multiple speakers, each corresponding to a different digital power amplifier, the speakers being used to play the audio data output by the corresponding digital power amplifier; and a controller configured to: after the display device is powered on, if it is detected that it is currently in a first mode where the audio processing chip is enabled, generate a first configuration instruction and... Multiple second configuration instructions; the first configuration instruction includes multiple first sound effect parameters, each first sound effect parameter corresponding to a channel, the first sound effect parameter being used to perform sound effect processing on the audio data of the corresponding channel; each second configuration instruction includes a sound quality control parameter corresponding to a channel, the sound quality control parameter being used to perform sound quality control processing on the audio data of the corresponding channel; sending the first configuration instruction to the audio processing chip, so that the audio processing chip responds to the first configuration instruction and configures the corresponding first sound effect parameter for the channel; and sending the second configuration instruction corresponding to the same channel to the digital power amplifier, so that the digital power amplifier responds to the second configuration instruction and configures the corresponding sound quality control parameter.
[0006] The above technical solution has the following advantages or beneficial effects: it liberates high-performance audio processing from the resource-constrained SoC by using an audio processing chip; it fundamentally eliminates channel crosstalk by independently driving and optimizing multiple digital power amplifiers; and it compensates for the differences in the hardware units themselves by individually configuring the sound effect parameters and sound quality control parameters of each channel, thereby improving acoustic performance and sound effect expression.
[0007] In some embodiments, after sending a first configuration instruction to the audio processing chip and a second configuration instruction corresponding to the same channel to the digital power amplifier, the controller is further configured to: decode the encoded data of the target audio in response to the instruction to play the target audio to obtain a plurality of first audio data, each first audio data corresponding to a channel; transmit the plurality of first audio data to the audio processing chip; the audio processing chip is configured to: after receiving the plurality of first audio data, perform sound effect processing on the first audio data corresponding to the corresponding channel using a plurality of first sound effect parameters to obtain a plurality of second audio data; transmit the plurality of second audio data to the digital power amplifier of the corresponding channel; the plurality of digital power amplifiers are configured to: after receiving the second audio data, perform sound quality control processing on the second audio data using configured sound quality control parameters to obtain third audio data; transmit the third audio data to the corresponding speaker; the plurality of speakers are configured to: play the third audio data after receiving the third audio data.
[0008] The above technical solution has the following advantages or beneficial effects: The audio processing chip processes the first audio data of the corresponding channel using audio effect parameters specific to each channel, enabling personalized audio enhancement for different channel data and improving the sense of auditory immersion. Each channel is equipped with an independent digital power amplifier, and the second audio data of the corresponding channel is optimized using audio quality control parameters specific to each channel, effectively matching speaker characteristics, reducing distortion, and improving the clarity and dynamic performance of the output sound quality.
[0009] In some embodiments, after the display device is powered on, if it is detected that the current mode is a first mode with the audio processing chip enabled, the controller generates a first configuration instruction, which is further configured to: obtain the currently set sound effect mode; if the currently set sound effect mode is the first sound effect mode, obtain the first audio type corresponding to the first sound effect mode, and determine multiple first sound effect parameters corresponding to the first audio type based on the correspondence between audio type and sound effect parameters; generate the first configuration instruction based on the multiple first sound effect parameters; or, if the currently set sound effect mode is the second sound effect mode, read the initially set second audio type; determine multiple first sound effect parameters corresponding to the second audio type based on the correspondence between audio type and sound effect parameters; generate the first configuration instruction based on the multiple first sound effect parameters.
[0010] The above technical solution has the following advantages or beneficial effects: by automatically associating sound effect modes with audio types and dynamically generating configuration instructions based on the preset correspondence between audio types and sound effect parameters, users do not need to manually adjust parameters one by one, which significantly improves the convenience of sound effect configuration, significantly reduces the operation threshold, and meets the auditory preferences in different scenarios.
[0011] In some embodiments, the controller is further configured to: in response to an instruction to play target audio, if it is detected that the currently set sound effect mode is a second sound effect mode, obtain the audio type of the target audio; determine multiple second sound effect parameters corresponding to the audio type of the target audio based on the correspondence between the audio type and the sound effect parameters, each second sound effect parameter corresponding to a channel; generate a third configuration instruction based on the multiple second sound effect parameters; and send the third configuration instruction to the audio processing chip; the audio processing chip is further configured to: in response to the third configuration instruction, replace the currently configured sound effect parameters of the channel with the corresponding second sound effect parameters; and after receiving multiple first audio data, perform sound effect processing on the first audio data corresponding to the corresponding channel using the multiple second sound effect parameters to obtain multiple second audio data.
[0012] The above technical solution has the following advantages or beneficial effects: When the current sound effect mode is set to the second sound effect mode, it can automatically match the sound effect parameters specific to each channel data according to the actual audio type being played. Without increasing the user's burden, it significantly improves the adaptability, professionalism, and immersiveness of the sound effects.
[0013] In some embodiments, the controller executes an instruction to play target audio, and if it detects that the currently set sound effect mode is the second sound effect mode, it obtains the audio type of the target audio. This is further configured to: in response to an instruction to play target audio, if it detects that the currently set sound effect mode is the second sound effect mode, obtain equalization filter parameters of a preset plurality of frequency bands of the target audio; and obtain the audio type of the target audio based on the equalization filter parameters of the preset plurality of frequency bands.
[0014] The above technical solution has the following advantages or beneficial effects: by monitoring the spectral characteristics reflected by the equalization filter parameters, the audio type can be obtained in real time so that the sound effect parameters corresponding to the audio type can be configured in the future, so that the sound effect processing always matches the current audio content, thereby improving the adaptability, professionalism and immersion of the sound effect.
[0015] In some embodiments, during playback of target audio, the controller is further configured to: acquire status data of a plurality of digital power amplifiers, the status data including temperature and power; when the temperature of a digital power amplifier is detected to exceed a safety threshold, send a command to the digital power amplifier to reduce the maximum gain of the channel, thereby reducing the output power of the digital power amplifier; and when the power of a digital power amplifier is detected to exceed a rated value, send a command to the digital power amplifier to adjust the compression ratio of the dynamic range control, thereby activating a transient limiter of the digital power amplifier, the transient limiter being used to limit the amplitude of the audio output.
[0016] The above technical solution has the following advantages or beneficial effects: When the temperature exceeds the safety threshold, it actively reduces the maximum gain of the channel, thereby reducing the power amplifier output power and heat generation, and avoiding chip aging, solder joint failure, or even burnout caused by continuous high temperature. When the output power approaches or exceeds the rated value, it can automatically adjust the compression ratio of the dynamic range control, activate the transient limiter, and smooth and limit sudden large peaks in the audio signal, which can prevent clipping distortion, speaker diaphragm overshoot, or power amplifier overcurrent, thus protecting the speaker and power amplifier circuits and avoiding harsh popping or sound quality degradation.
[0017] In some embodiments, after the display device is powered on, if it is detected that the current mode is a first mode with the audio processing chip enabled, the controller generates a plurality of second configuration instructions, which are further configured to: read a plurality of frequency response calibration data from the factory settings file, each frequency response calibration data corresponding to a channel; calculate the equalization filter parameters of the corresponding channel based on the plurality of frequency response calibration data; and generate a plurality of second configuration instructions, each second configuration instruction including equalization filter parameters corresponding to a channel.
[0018] The above technical solution has the following advantages or beneficial effects: Different channels of the same model of equipment may have inconsistent frequency response characteristics. By providing individual frequency response calibration data for each channel and calculating dedicated equalization parameters, individual differences can be effectively compensated, making the output of each channel closer to the ideal target curve, and significantly improving the consistency and sound field symmetry between channels.
[0019] In some embodiments, after the display device is powered on, if it is detected that the current state is a first mode with the audio processing chip enabled, the controller generates a plurality of second configuration instructions, which are further configured to: calculate a plurality of delays based on the distances between the plurality of speakers and the user's position, each delay corresponding to a channel; and generate a plurality of second configuration instructions, each second configuration instruction including a delay corresponding to a channel.
[0020] The above technical solution has the following advantages or beneficial effects: When the user is not at the geometric center of the speaker, there is a time difference in the arrival time of the sound from different channels to the human ear, which can lead to sound image shift, blurred positioning, or even phase cancellation. By applying an appropriate delay to the speaker channels that are relatively close together, the sound from all channels can arrive at the user's listening position synchronously, thereby reconstructing the correct sound field center and ensuring accurate positioning of the sound source.
[0021] In some embodiments, after the display device is powered on, if it is detected that the current mode is a first mode with the audio processing chip enabled, the controller generates a plurality of second configuration instructions, which are further configured to: read a plurality of protection parameters from the factory settings file, each set of protection parameters corresponding to a channel, the protection parameters being a safety threshold preset to prevent damage to the digital power amplifier; calculate the dynamic range control parameters of the corresponding channel based on the plurality of protection parameters; and generate a plurality of second configuration instructions, each second configuration instruction including the dynamic range control parameters corresponding to a channel.
[0022] The above technical solution has the following advantages or beneficial effects: by configuring independent protection parameters for each channel and calculating exclusive dynamic range control parameters accordingly, precise and differentiated protection can be achieved.
[0023] Secondly, some embodiments of this application provide an audio processing parameter configuration method applied to a display device. The display device includes a display, an audio processing chip, multiple digital power amplifiers, and multiple speakers. The audio processing chip is used to support sound effect processing of multiple audio data corresponding to multiple channels. Different digital power amplifiers correspond to different channels. The digital power amplifiers are used to perform sound quality control processing on the audio data of the corresponding channel output by the audio processing chip. Different speakers correspond to different digital power amplifiers, and the speakers are used to play the audio data output by the corresponding digital power amplifiers. The method includes: after the display device is powered on, if it is detected that the current mode is a first mode with the audio processing chip enabled... The system generates a first configuration instruction and multiple second configuration instructions. The first configuration instruction includes multiple first sound effect parameters, each corresponding to a channel, and the first sound effect parameters are used to perform sound effect processing on the audio data of the corresponding channel. Each second configuration instruction includes a sound quality control parameter corresponding to a channel, and the sound quality control parameter is used to perform sound quality control processing on the audio data of the corresponding channel. The system sends the first configuration instruction to the audio processing chip so that the audio processing chip responds to the first configuration instruction and configures the corresponding first sound effect parameters for the channel. The system also sends a second configuration instruction corresponding to the same channel to the digital power amplifier so that the digital power amplifier responds to the second configuration instruction and configures the corresponding sound quality control parameters.
[0024] The above technical solution has the following advantages or beneficial effects: The audio processing chip processes the first audio data of the corresponding channel using audio effect parameters specific to each channel, enabling personalized audio enhancement for different channel data and improving the sense of auditory immersion. Each channel is equipped with an independent digital power amplifier, and the second audio data of the corresponding channel is optimized using audio quality control parameters specific to each channel, effectively matching speaker characteristics, reducing distortion, and improving the clarity and dynamic performance of the output sound quality.
[0025] The technical solution provided in this application can generate a first configuration instruction and multiple second configuration instructions after the display device is powered on, if it is detected that the current mode of the audio processing chip is enabled. The first configuration instruction includes multiple first sound effect parameters, each corresponding to a channel, and is used to perform sound effect processing on the audio data of the corresponding channel. Each second configuration instruction includes a sound quality control parameter corresponding to a channel, which is used to perform sound quality control processing on the audio data of the corresponding channel. The first configuration instruction is sent to the audio processing chip so that the audio processing chip, in response to the first configuration instruction, configures the corresponding first sound effect parameters for the channel; and the second configuration instruction corresponding to the same channel is sent to the digital power amplifier so that the digital power amplifier, in response to the second configuration instruction, configures the corresponding sound quality control parameters. This application embodiment liberates high-performance audio processing from the resource-constrained SoC through the audio processing chip, fundamentally eliminates channel crosstalk through the independent driving and optimization of multiple digital power amplifiers, and compensates for the differences in the hardware units themselves by individually configuring the sound effect parameters and sound quality control parameters of each channel, thereby improving acoustic performance and sound effect expression. Attached Figure Description
[0026] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0027] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application; Figure 2 is a schematic diagram of the overall hardware configuration of a display device provided in some embodiments of this application; Figure 3 is a schematic diagram of the partial hardware configuration of a display device provided in some embodiments of this application; Figure 4 is a schematic diagram of the software configuration of a display device provided in some embodiments of this application; Figure 5 is a flowchart of an audio processing parameter configuration method provided in some embodiments of this application; Figure 6 is a timing diagram of hardware initialization provided in some embodiments of this application; Figure 7 is a schematic diagram of a sound settings page provided in some embodiments of this application; Figure 8 is a schematic diagram of an audio mode settings page provided in some embodiments of this application; Figure 9 is a timing diagram of an audio processing parameter configuration method provided in some embodiments of this application; Figure 10 is a flowchart of an audio playback method provided in some embodiments of this application; Figure 11 is an architecture diagram of a target audio playback method provided in some embodiments of this application; Figure 12 is a timing diagram of a target audio playback method provided in some embodiments of this application; Figure 13 is a timing diagram of a status monitoring and tuning method provided in some embodiments of this application; Figure 14 is a timing diagram of an audio playback stop method provided in some embodiments of this application. Detailed Implementation
[0028] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.
[0029] In this application embodiment, display device 200 generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
[0030] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application. As shown in Figure 1, a user can operate the display device 200 through touch operation, a mobile terminal 300, and a control device 100. The control device 100 is used to receive operation commands input by the user and convert these commands into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.
[0031] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.
[0032] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.
[0033] As also shown in Figure 1, the display device 200 communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0034] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.
[0035] Figure 2 is a hardware configuration block diagram of the display device 200 in Figure 1 provided in some embodiments of this application.
[0036] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.
[0037] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0038] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.
[0039] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.
[0040] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.
[0041] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.
[0042] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0043] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface 280 receives the user input commands through the graphical user interface (GUI).
[0044] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.
[0045] In this embodiment of the application, the audio output device 270 may include a plurality of speakers. Taking the speaker system described in 5.1.2 as an example, the audio output device 270 may include a left front speaker, a right front speaker, a center speaker, a left surround speaker, a right surround speaker, a subwoofer speaker, a left sky speaker, and a right sky speaker.
[0046] As shown in Figure 3, the controller 250 is integrated on a system-on-a-chip (SoC). The SoC acts as the system's control core and initial processing unit, responsible for receiving various encoded audio signals from the outside and performing the primary decoding and separation tasks. Its goal is to convert and separate the input compressed audio stream into independent, uncolored, multi-channel digital audio streams, providing a clean, original signal for subsequent refined processing.
[0047] In this embodiment, the audio processing chip is essentially an immersive sound field rendering engine. As an independent audio coprocessor, the audio processing chip receives multi-channel digital audio streams from the system-on-a-chip (SoC). The audio processing chip incorporates a high-performance audio digital signal processor specifically designed to run computationally intensive multi-channel audio effects algorithms and immersive sound field rendering. For example, the high-performance audio digital signal processor precisely locates object-based audio and applies advanced audio effects processing to construct an audio scene with a three-dimensional spatial feel, including overhead channels.
[0048] In this embodiment, the digital amplifier (DAMP) array is an array composed of multiple independent digital power amplifiers. The processed audio data is fed into the digital power amplifier array. In this architecture, each channel corresponds to one digital power amplifier.
[0049] In this embodiment, the speaker array consists of multiple speakers integrated within the display device 200, and can be arranged according to the physical specifications of 5.1.2 channels. The speaker array can receive drive signals from the digital power amplifier array, accurately converting electrical signals into sound waves, and ultimately reproducing a realistic three-dimensional sound field with front, side, and overhead sound localization.
[0050] In some embodiments, the user input interface 280 can be used to receive instructions from user input.
[0051] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.
[0052] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.
[0053] As shown in Figure 4, the display device system is divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.
[0054] The application layer mainly includes commonly used applications on the TV, as well as the application framework. Commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps. The application framework is a complete program model with all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces for these functions (toolbar, status bar, menu, dialog box).
[0055] Native apps can support online or offline access, push notifications, or access to local resources.
[0056] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.
[0057] In this embodiment, the system components include an audio effects processing layer and an audio management layer. The audio effects processing layer controls the audio processing chip via the Inter-Integrated Circuit (IIC) protocol. The audio processing chip is a proprietary audio effects processing engine capable of implementing advanced audio effects algorithms, multi-channel audio effects rendering, and real-time audio effects processing, and then sending the processed audio to the digital power amplifier. The audio management layer is the overall control module of the audio system, used to manage the audio lifecycle, coordinate audio effects processing and device output, and handle audio strategies and routing.
[0058] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each individual chip. Drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, High-Definition Multimedia Interface (HDMI) drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.
[0059] In this embodiment, the hardware and driver include a device driver layer. The device driver layer is a hardware abstraction layer used to configure and manage digital power amplifier parameters, and to provide a unified device interface.
[0060] In this embodiment, the audio management layer can send configuration commands for sound effect parameters and sound quality control parameters to the device driver layer. The device driver layer can send the sound effect parameters of each channel to the audio processing chip, and send the sound quality control parameters of each digital power amplifier to the corresponding digital power amplifier. The audio management layer sends audio data from multiple channels to the device driver layer, so that the device driver layer sends the audio data from multiple channels to the audio processing chip. The sound effect processing layer can control the audio processing chip to perform sound effect processing on the audio. The device driver layer can also obtain the status data of the digital power amplifier and send the status data to the audio management layer. The audio management layer can analyze the status data and make corresponding decisions.
[0061] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.
[0062] With the popularization of ultra-high-definition display technology and the explosive growth in demand for immersive audio-visual entertainment, televisions have transformed from simple audio-visual terminals into home entertainment centers. Users have increasingly demanding requirements for audio-visual experiences, not only pursuing 4K / 8K visual resolution but also seeking multi-dimensional immersive audio experiences comparable to cinemas. Against this backdrop, support for object-based 5.1.2 multi-channel audio formats such as Dolby Atmos has become a key technological focus for high-end television products.
[0063] There are two main types of solutions for implementing multi-channel audio on televisions: 1. Virtual multi-channel solution: Most televisions use an audio processor integrated into the motherboard's system-on-a-chip (SoC) to virtually simulate overhead and surround sound effects using psychoacoustic algorithms. This solution is low-cost and requires no additional hardware, but its sound field performance is blurry, its spatial positioning is poor, and it cannot accurately reproduce the precise location of sound objects, making it difficult to meet the listening needs of high-end users.
[0064] 2) External Audio Solution: Users can connect external soundbars or home theater amplifier systems via interfaces such as HDMI Enhanced Audio Return Channel (eARC) to obtain a true multi-channel experience. This solution offers excellent results, but it brings additional equipment costs, complex wiring, and issues such as the inability of peripherals to seamlessly coordinate with the TV remote, thus compromising the simplicity and ease of use of the TV as an integrated entertainment terminal.
[0065] To achieve true multi-channel audio output within the TV body, multiple built-in physical speaker units can independently drive each channel, providing a native, immersive audio experience without the need for external devices. However, due to the extremely compact internal space of a TV and severely limited heat dissipation, it is impossible to solve problems such as multi-channel decoding computing power, independent drive power, and fine-grained management between channels within an ultra-thin body.
[0066] In some embodiments, the technical approach may focus on the stacking and layout of speaker units. However, in the core audio processing and driving architecture, the computing power bottleneck of traditional SoC integration solutions and the performance limitations of integrated amplifier solutions have not been broken. This results in insufficient separation of each channel, coarse sound effect optimization granularity, and difficulty in fully unleashing the full potential of the 5.1.2 true multi-channel system.
[0067] In summary, the existing technology's shortcomings and problems are as follows: 1) The SoC audio processing performance bottleneck prevents the deployment of advanced audio processing units. Multi-channel decoding and sound effect rendering in televisions heavily rely on the audio processing units built into their system-on-a-chip (SoC). However, the SoC must simultaneously handle heavy tasks such as video decoding, operating system operation, and application processing, leaving very limited computing resources allocated to audio processing. This prevents it from efficiently and effectively running the complex rendering algorithms required for 5.1.2 multi-channel audio (especially object-based Dolby Atmos). The resulting sound field is often flat, with blurred positioning, and a weak presence of sky channels. The multi-channel experience relies primarily on psychoacoustic simulation rather than physical realism, failing to meet the demands of a high-end audio experience.
[0068] 2) Channel crosstalk and performance limitations caused by integrated amplification architecture. Most televisions use a single or highly integrated amplifier chip to drive all speaker units. In this architecture, there is severe path crosstalk and power contention in the final amplification stage. For example, when one channel (such as the subwoofer) requires high power output, it momentarily lowers the supply voltage, causing compression and distortion in all other channels (such as the delicate dialogue output of the center channel). This completely destroys the high channel separation required for a 5.1.2 system, making the sound, which should be precisely positioned, muddy and unclear, and significantly reducing the surround sound and immersion.
[0069] 3) The lack of channel-level fine-tuning capabilities. Existing integrated solutions cannot perform independent, fine-tuned digital signal processing on each channel in a 5.1.2 system. All channels are forced to accept globally uniform processing parameters, such as equalizers and dynamic range control. However, due to differences in physical characteristics, installation location, and acoustic role, the frequency response curves and optimal operating points of speaker units in different channels vary significantly. A uniform processing strategy cannot compensate for these performance differences, resulting in unbalanced volume and inconsistent timbre across channels, failing to unleash the full potential of the 5.1.2 true multi-channel system.
[0070] To address the above technical problems, this application provides a display device 200. The structure and functions of each part of the display device 200 can be found in the above embodiments. Furthermore, based on the display device 200 shown in the above embodiments, this embodiment further improves some functions of the display device 200. As shown in FIG5, the controller 250 (at least one processor) causes the display device 200 to perform the following steps by running an application program: Step S501: The display device 200 is powered on.
[0071] In response to a user-input power-on command, the display device 200 executes the power-on process. During the power-on process, the controller 250 can send power-on initialization commands to the audio processing chip and multiple digital power amplifiers, which then complete the power-on initialization operations.
[0072] In this embodiment, the audio processing chip and multiple digital power amplifiers are activated immediately upon receiving the power-on command from the display device 200. This avoids the need to wait for hardware initialization after receiving a user input command to play audio, thus improving the response speed of audio playback.
[0073] In some embodiments, the hardware initialization timing diagram of the display device 200 may be as shown in Figure 6. After receiving a power-on command, the controller 250 sends power-on and initialization commands to the audio processing chip. After powering on and completing initialization, the audio processing chip sends an initialization completion confirmation message to the controller 250. The controller 250 sends configured audio parameters to the audio processing chip. The audio parameters include sampling rate, bit width, and channel mapping. After configuring the parameters, the audio processing chip sends a parameter configuration confirmation message to the controller 250.
[0074] The sampling rate is the number of times the analog audio signal is sampled per second. Configuring the sampling rate ensures that the audio transmitter, audio processing chip, digital power amplifier, and speakers use a consistent or compatible sampling rate; otherwise, distortion, pitch shifting, or playback failure may occur. Bit width is the amplitude precision of each sample point. Configuring the bit width ensures that audio amplitude information is accurately represented, avoiding sound quality loss or clipping distortion. Channel mapping defines the correspondence between each channel in the audio data stream (such as left, right, center, surround, etc.) and the physical output (speakers). Configuring channel mapping ensures a one-to-one correspondence between logical audio channels and physical output devices, achieving accurate audio playback.
[0075] The controller 250 can also send power-on and initialization commands to multiple digital power amplifiers sequentially or simultaneously. After powering on and completing initialization, each digital power amplifier sends an initialization status to the controller 250. If the controller 250 confirms that the initialization status is normal, it sends protection parameters to the multiple digital power amplifiers. These protection parameters include temperature protection, overload protection, and a limiter. After setting the protection parameters, each digital power amplifier sends a protection parameter confirmation message to the controller 250.
[0076] Temperature protection involves setting a maximum permissible operating temperature threshold. When the internal temperature sensor of the digital power amplifier detects that the temperature of the chip or power device exceeds this threshold, the protection action is triggered. Temperature protection prevents the power amplifier from overheating and causing permanent damage to semiconductor devices during high volume or prolonged operation. Overload protection monitors the power amplifier's output current or load impedance. When an abnormal increase in current or output power exceeding the safe range is detected, protection is activated. Overload protection prevents current overload from burning out the power amplifier chip or power supply. The limiter is a dynamic signal processing function used to limit the peak amplitude of the audio signal to no more than a preset level. The limiter prevents the power amplifier from failing to amplify the signal linearly when the input signal is too large, thus preventing severe distortion and even high-frequency harmonics that could damage the tweeter.
[0077] Step S502: Detect whether the current mode is the first mode with the audio processing chip enabled.
[0078] After the audio processing chip and multiple digital power amplifiers are powered on and initialized, the controller 250 can detect whether it is currently in a first mode where the audio processing chip is enabled. Specifically, this can be achieved by retrieving a mode identifier from memory, which corresponds to either the default setting mode or a user-historical setting mode. If the mode identifier is a first preset value, it is determined that the current state is the first mode where the audio processing chip is enabled. If the mode identifier is a second preset value, it is determined that the current state is the second mode where the audio processing chip is not enabled. For example, the first preset value is 1, and the second preset value is 0.
[0079] In some embodiments, one implementation of setting whether the audio processing chip is enabled may include: controlling the display 260 to display the settings page in response to a user input command to open the settings page; controlling the display 260 to display the sound settings page in response to a user input confirmation operation on the sound settings controls in the settings page; and turning advanced sound effects on or off in response to a user confirmation operation on the advanced sound effects switch controls in the sound settings page. Enabling advanced sound effects indicates that the current mode is a first mode where the audio processing chip is enabled, and a first preset mode identifier is stored in memory. Disabling advanced sound effects indicates that the current mode is a second mode where the audio processing chip is not enabled, and a second preset mode identifier is stored in memory.
[0080] For example, as shown in Figure 7, the sound settings page includes an advanced sound effects switch control 71. The advanced sound effects switch can be turned on or off by receiving a user's confirmation of the advanced sound effects switch control 71.
[0081] In some embodiments, if it is detected that the current state is a second mode in which the audio processing chip is not enabled, the process ends, that is, there is no need to generate the first configuration instruction and multiple second configuration instructions.
[0082] In some embodiments, if it is detected that the current mode is a second mode where the audio processing chip is not enabled, only a plurality of second configuration instructions are generated and sent to the digital power amplifier corresponding to the same channel, so that the digital power amplifier responds to the second configuration instructions and configures the corresponding sound quality control parameters.
[0083] If it is detected that the current mode is the first mode with the audio processing chip enabled, then step S503 is executed: generate a first configuration instruction and a plurality of second configuration instructions.
[0084] The first configuration instruction includes multiple first sound effect parameters, each corresponding to a channel, and the first sound effect parameters are used to perform sound effect processing on the audio data of the corresponding channel; each second configuration instruction includes a sound quality control parameter corresponding to a channel, and the sound quality control parameter is used to perform sound quality control processing on the audio data of the corresponding channel.
[0085] It should be noted that the first configuration instruction can include the first sound effect parameters of all channels, or it can include the first sound effect parameters of some channels. For example, the first configuration instruction can include the first sound effect parameters of eight channels: left front, right front, center, left surround, right surround, subwoofer, left sky, and right sky, or it can only include the first sound effect parameters of the subwoofer channel.
[0086] In some embodiments, if it is detected that the current state is a first mode with the audio processing chip enabled, one implementation of generating a first configuration instruction may include: reading a plurality of pre-set first sound effect parameters and generating a first configuration instruction based on the plurality of first sound effect parameters.
[0087] In some embodiments, if it is detected that the current mode is a first mode with the audio processing chip enabled, another implementation of generating the first configuration instruction may include: obtaining the currently set sound effect mode. If the currently set sound effect mode is the first sound effect mode, obtain the first audio type corresponding to the first sound effect mode, and based on the correspondence between audio type and sound effect parameters, determine multiple first sound effect parameters corresponding to the first audio type, and then generate the first configuration instruction based on the multiple first sound effect parameters. Alternatively, if the currently set sound effect mode is the second sound effect mode, read the initially set second audio type, and based on the correspondence between audio type and sound effect parameters, determine multiple first sound effect parameters corresponding to the second audio type, and then generate the first configuration instruction based on the multiple first sound effect parameters.
[0088] The currently set sound effect mode can be the default setting, a user-hidden setting, or a previously set sound effect mode. The first sound effect mode corresponds to the audio type. Audio types can be categorized based on their source, such as movie, game, and music. Correspondingly, the first sound effect mode can include movie mode, game mode, and music mode, etc. The correspondence between audio type and sound effect parameters can be stored in a sound effect parameter mapping table. Each audio type corresponds to multiple sound effect parameters, and each sound effect parameter corresponds to one channel. Sound effect parameters refer to specific values or configuration items used to control and adjust audio processing effects. Sound effect parameters can include equalizer-related parameters, dynamic processing parameters, spatial sound effect parameters, dialogue / voice enhancement parameters, and bass management parameters, etc.
[0089] The second sound effect mode is one that automatically updates sound effect parameters based on the audio category. For example, the second sound effect mode can be an Artificial Intelligence (AI) mode. When the currently set sound effect mode is the second sound effect mode, the initially set second audio type can be read. The second audio type can be the default audio type, or it can be the most frequently set audio type based on the user's historical settings, or the last set audio type.
[0090] In some embodiments, one implementation of setting a sound effect mode may include: controlling the display 260 to display a settings page in response to a user input command to open a settings page; controlling the display 260 to display a sound settings page in response to a user input confirmation operation on a sound settings control in the settings page; and controlling the display 260 to display a sound effect mode settings page in response to a user input confirmation operation on a sound effect mode settings control in the sound settings page. The sound effect mode settings page includes a first sound effect mode control and a second sound effect mode control. In response to a user confirmation operation on either the first or second sound effect mode control, the sound effect mode is set to the first sound effect mode corresponding to the first sound effect mode control or the second sound effect mode corresponding to the second sound effect mode control.
[0091] For example, as shown in Figure 7, the sound settings page also includes a sound effect mode setting control 72. Upon receiving user confirmation of the sound effect mode setting control 72, the audio mode settings page shown in Figure 8 can be displayed. The sound effect mode setting page includes a movie mode control 811, a previous control 812, and a next control 813. Upon receiving user confirmation of the previous control 812 or the next control 813, the selected sound effect mode can be switched.
[0092] In some embodiments, the sound quality control parameters may include equalizer (PEQ) parameters. One implementation of generating multiple second configuration instructions if the audio processing chip is detected to be in a first mode is as follows: if the audio processing chip is detected to be in a first mode is as follows, multiple frequency response calibration data are read from a factory settings file, each frequency response calibration data corresponding to one channel. Then, equalizer parameters for the corresponding channels are calculated based on the multiple frequency response calibration data, and finally, multiple second configuration instructions are generated, each second configuration instruction including equalizer parameters corresponding to one channel.
[0093] The equalization filter parameters are used to adjust the gain or attenuation of different frequency components to compensate for speaker frequency response defects. During the production of display device 200, the frequency response of each speaker channel can be measured, and the obtained frequency-amplitude response curve data is then written into the factory setting file of display device 200 as calibration data. After display device 200 is powered on, the frequency response calibration data of each channel can be read from the factory setting file. Then, the calibration data of each channel is reverse-analyzed to calculate a set of equalization filter parameters, typically multiple PEQ segments, to make the overall filtered response as close as possible to the target curve.
[0094] In some embodiments, the sound quality control parameters may include delays. One implementation of generating multiple second configuration instructions if a first mode with the audio processing chip enabled is detected may include: if a first mode with the audio processing chip enabled is detected, calculating multiple delays based on the distances between multiple speakers and the user's position, each delay corresponding to one channel, and then generating multiple second configuration instructions, each second configuration instruction including a delay corresponding to one channel.
[0095] Delay refers to applying a time delay to a specific audio channel to correct for differences in acoustic paths or to create spatial effects. In home theaters or multi-channel systems, because the speakers are at different distances from the listening position, delay is needed to ensure that the sound from each channel reaches the user's ears simultaneously.
[0096] In some embodiments, one implementation of calculating multiple delays based on the distances between multiple speakers and the user's position may include: receiving user input of the distances between each speaker and the user, or obtaining the distances between each speaker and a preset optimal viewing position for the user, and then automatically calculating the delays based on the distances.
[0097] For example, the delay calculation method can be as follows: distance between the left front speaker (L) and the user: d1; distance between the right front speaker (R) and the user: d2; distance between the center speaker (C) and the user: d3; distance between the left surround speaker (SL) and the user: d4 (farthest); distance between the right surround speaker (SR) and the user: d5; distance between the subwoofer (LFE) and the user: d6. The delay of the left front speaker is t1 = (d4 - d1) / v; the delay of the right front speaker is t2 = (d4 - d2) / v; the delay of the center speaker is t3 = (d4 - d3) / v; the delay of the left surround speaker is t4 = 0 (farthest, no delay required); the delay of the right surround speaker is t5 = (d4 - d5) / v; the delay of the subwoofer is t6 = (d4 - d6) / v. Where v is the speed of sound.
[0098] In some embodiments, another implementation of calculating multiple delays based on the distances between multiple speakers and the user's position may include: after receiving a delay correction instruction input by the user, the display device 200 sequentially plays test tones through each speaker, the user holds a microphone or remote control at the viewing position, and uses the microphone or remote control to collect the played test tones to obtain the arrival time of the test tones played by each speaker, then calculates the distance from each speaker to the user based on the arrival time, and then calculates the delay of each channel based on the distance.
[0099] In some embodiments, another implementation of calculating multiple delays based on the distances of multiple speakers to the user's location may include: calculating the user's spatial location based on an image captured by a camera built into or external to the display device 200; or, emitting a millimeter-wave signal using a millimeter-wave radar built into or external to the display device 200, then receiving the signal reflected back from the user, and determining the user's spatial location based on the transmitted and reflected signals. The distances from each speaker to the user are then calculated based on the user's spatial location, and the delay for each channel is calculated based on these distances.
[0100] In some embodiments, the audio quality adjustment parameters include Dynamic Range Control (DRC). One implementation of generating multiple second configuration instructions if the audio processing chip is detected to be in a first mode with the audio processing chip enabled may include: reading multiple sets of protection parameters from a factory settings file, each set of protection parameters corresponding to one channel; calculating the dynamic range control parameters for each corresponding channel based on the multiple sets of protection parameters; and finally generating multiple second configuration instructions based on the dynamic range control parameters. Each second configuration instruction includes the dynamic range control parameters corresponding to one channel.
[0101] Among these, protection parameters are pre-set safety thresholds to prevent damage to the digital power amplifier. Protection parameters may include temperature protection parameters, overcurrent / short-circuit protection parameters, and limiter-related parameters. Temperature protection parameters prevent permanent damage to the chip or power amplifier due to overheating. Overcurrent / short-circuit protection parameters prevent excessive current from burning out the power amplifier or speaker voice coil. Limiter-related parameters prevent high-frequency energy from clipping distortion from damaging the tweeter. Dynamic range control parameters are the mathematical description of the dynamic range control curve. Dynamic range control automatically adjusts the contrast of audio signals, compressing the large dynamic range to better suit the current playback environment or equipment capabilities.
[0102] Step S504: Send a first configuration command to the audio processing chip so that the audio processing chip, in response to the first configuration command, configures the corresponding first sound effect parameters for the channel; and send a second configuration command corresponding to the same channel to the digital power amplifier so that the digital power amplifier, in response to the second configuration command, configures the corresponding sound quality control parameters.
[0103] In some embodiments, the audio processing chip, in response to a first configuration instruction, can configure corresponding first sound effect parameters for each channel, and can also configure corresponding first sound effect parameters for some channels.
[0104] In some embodiments, after sending a first configuration instruction to the audio processing chip to configure corresponding first sound effect parameters for the channel in response to the first configuration instruction, additional audio playback effects can be set by the user in the already set sound effect mode. The specific method may include: obtaining multiple third sound effect parameters corresponding to the currently set audio playback effect, and generating a fourth configuration instruction based on the multiple third sound effect parameters. Each third sound effect parameter corresponds to one channel. The fourth configuration instruction is sent to the audio processing chip to replace the currently configured sound effect parameters of the channel with the corresponding third sound effect parameters in response to the fourth configuration instruction.
[0105] It should be noted that the fourth configuration command may include the third sound effect parameters corresponding to all or some of the channels. For example, if the user selects to set the bass enhancement effect in movie mode, the sound effect parameters of the subwoofer channel corresponding to the bass enhancement effect are obtained, and a configuration command is generated based on the sound effect parameters of the subwoofer channel. If the user selects stereo surround volume, the sound effect parameters of multiple channels corresponding to the stereo surround volume are obtained. These multiple channels include left and right front channels and left and right surround channels. A configuration command is generated based on the sound effect parameters of these multiple channels.
[0106] It should also be noted that if the fourth configuration instruction includes the third sound effect parameters for all channels, then in response to the fourth configuration instruction, the sound effect parameters configured for all channels are replaced with the third sound effect parameters. If the fourth configuration instruction only includes the third sound effect parameters for some channels, then in response to the fourth configuration instruction, the sound effect parameters configured for those channels are replaced with the third sound effect parameters, while the sound effect parameters for the channels other than those channels remain unchanged.
[0107] For example, as shown in Figure 8, the sound effect mode settings page also includes a stereo volume control 821, a subwoofer control 822, an equalizer control 823, and an auto volume control 824. If a user selects the subwoofer control 822 to input a command to automatically adjust the subwoofer, the corresponding sound effect parameters can be configured for the subwoofer channel.
[0108] In some embodiments, the timing diagram of the audio processing parameter configuration method can be as shown in Figure 9. The controller 250 obtains the currently set sound effect mode, generates a first configuration instruction, and sends the first configuration instruction to the audio processing chip. The first configuration instruction includes multiple first sound effect parameters. The audio processing chip configures the corresponding first sound effect parameters for each channel and then sends a mode switching completion message to the controller 250. The controller 250 obtains the currently set audio playback effect, generates a fourth configuration instruction, and sends the fourth configuration instruction to the audio processing chip. The fourth configuration instruction includes third sound effect parameters corresponding to the audio playback effect. The audio processing chip configures the corresponding third sound effect parameters for each channel and then sends a parameter confirmation message to the controller 250.
[0109] Controller 250 reads frequency response calibration data for multiple channels from the factory settings file, calculates the equalization filter parameters for each channel, and sends these parameters to the corresponding digital power amplifier. The digital power amplifier verifies and applies the parameters and then sends a parameter confirmation message to controller 250. Controller 250 calculates the delay for each channel based on the distance between the multiple speakers and the user's location and sends the delay to the corresponding digital power amplifier. The digital power amplifier configures the delay parameters and sends a delay parameter confirmation message to controller 250. Controller 250 reads protection parameters from the factory settings file, calculates the dynamic range control parameters for each channel based on these parameters, and then sends the dynamic range control parameters to the corresponding digital power amplifier. The digital power amplifier configures the dynamic range control parameters and sends a parameter confirmation message to controller 250.
[0110] In some embodiments, as shown in FIG10, the device is currently in a first mode with the audio processing chip enabled. After configuring the sound effect parameters and sound quality control parameters, the display device 200 can also perform the following steps: The controller 250 performs step S1001: In response to the instruction to play the target audio, it decodes the encoded data of the target audio to obtain multiple first audio data. Each first audio data corresponds to one channel.
[0111] In some embodiments, during the decoding of the encoded data of the target audio, metadata or header information of the audio stream can be obtained. This metadata or header information includes key parameters such as sampling rate, bit depth, number of channels, encoding format, bit rate, and duration. Based on the metadata or header information, it is determined whether the number of channels is the same as and corresponds to the number of speakers. If the number of channels and speakers are the same and correspond to each other, decoding can be performed directly. For example, if the audio stream in 5.1.2 has 8 channels, and the display device 200 also has 8 speakers, and the 8 speakers correspond to the 8 channels, then the audio stream is decoded to obtain audio data for 8 channels.
[0112] When the number of channels is less than the number of speakers, the audio stream is decoded to obtain audio data with n channels. Then, upmixing is used to expand the audio data with n channels into audio data with m channels, where m > n, and the number of speakers is also m. Upmixing refers to expanding an audio signal with fewer channels (such as mono or stereo) into an audio format with more channels (such as 5.1 or 7.1 surround sound) to adapt to multi-speaker systems.
[0113] When the number of audio channels exceeds the number of speakers, the audio stream is decoded to obtain audio data with n channels. Then, through downmixing, the audio data with n channels is merged into audio data with m channels, where m < n, and the number of speakers is also m. Downmixing refers to the process of merging multi-channel audio into an audio format with fewer channels.
[0114] The controller 250 executes step S1002: transmitting multiple first audio data to the audio processing chip.
[0115] In some embodiments, in response to a command to play target audio, the controller 250 may further perform the following: Obtain the currently set sound effect mode. If the currently set sound effect mode is a first sound effect mode, no operation related to sound effect parameter adjustment is required. If the currently set sound effect mode is a second sound effect mode, obtain the audio type of the target audio, then determine multiple second sound effect parameters corresponding to the audio type of the target audio based on the correspondence between the audio type and the sound effect parameters, then generate a third configuration command based on the multiple second sound effect parameters, and finally send the third configuration command to the audio processing chip. Each second sound effect parameter corresponds to one channel.
[0116] In some embodiments, when the currently set sound effect mode is the second sound effect mode, one implementation of obtaining the audio type of the target audio may include: when the currently set sound effect mode is the second sound effect mode, parsing the instruction to play the target audio to obtain the audio type of the target audio.
[0117] In some embodiments, when the currently set sound effect mode is the second sound effect mode, one implementation for obtaining the audio type of the target audio may include: obtaining equalization filter parameters for a preset plurality of frequency bands of the target audio when the currently set sound effect mode is the second sound effect mode, and then obtaining the audio type of the target audio based on the equalization filter parameters for the preset plurality of frequency bands. The equalization filter parameters for the preset plurality of frequency bands may be parameters for a 30-band PEQ.
[0118] The audio processing chip executes step S1003: using multiple first sound effect parameters to process the first audio data corresponding to the corresponding channel to obtain multiple second audio data.
[0119] In some embodiments, when the currently set sound effect mode is the first sound effect mode, the audio processing chip can directly use multiple first sound effect parameters to process the first audio data corresponding to the corresponding channel, thereby obtaining multiple second audio data. When the currently set sound effect mode is the second sound effect mode, the audio processing chip can respond to a third configuration instruction to replace the currently configured sound effect parameters of the channel with the corresponding second sound effect parameters. Then, after receiving multiple first audio data, the chip uses multiple second sound effect parameters to process the first audio data corresponding to the corresponding channel, thereby obtaining multiple second audio data.
[0120] It should be noted that the third configuration instruction may include second sound effect parameters corresponding to all or some channels. If the third configuration instruction includes second sound effect parameters for all channels, then in response to the third configuration instruction, the sound effect parameters configured for all channels are replaced with the second sound effect parameters. If the third configuration instruction only includes second sound effect parameters for some channels, then in response to the third configuration instruction, the sound effect parameters configured for those channels are replaced with the second sound effect parameters, while the sound effect parameters for the channels other than those channels remain unchanged. This application embodiment does not limit the order in which the steps of generating and sending the third configuration instruction and the steps of decoding the encoded data of the target audio are executed; it only needs to ensure that the configuration of the second sound effect parameters is completed before multiple first audio data are received.
[0121] The audio processing chip executes step S1004: transmitting multiple second audio data to the digital power amplifier of the corresponding channel respectively.
[0122] Each of the multiple digital power amplifiers executes step S1005: using the configured audio quality control parameters to perform audio quality control processing on the received second audio data to obtain the third audio data.
[0123] Each of the multiple digital power amplifiers performs step S1006: transmitting the third audio data to the corresponding speaker.
[0124] Each of the multiple speakers performs step S1007: playing the received third audio data.
[0125] In some embodiments, the architecture of the target audio playback method can be as shown in Figure 11. An encoded audio stream is input to the controller 250 via an audio source, including HDMI, optical fiber, or streaming media. The controller 250 decodes and separates the encoded audio stream into a multi-channel Pulse Code Modulation (PCM) data stream, and then sends the multi-channel PCM data stream to the audio processing chip. The audio processing chip performs sound effect processing on the multi-channel streams, and then sends the processed data for each channel to the corresponding digital power amplifier. Each digital power amplifier performs final-stage amplification and sound quality control processing using its own sound quality control parameters, and then sends the sound quality-controlled audio to the corresponding speaker. The speaker plays the audio for the corresponding channel.
[0126] In some embodiments, the timing diagram of the target audio playback method can be as shown in Figure 12. After receiving an audio playback instruction, the audio / video application sends an audio playback request to the controller 250, the audio playback request including the audio type. When the controller 250 detects that the sound effect mode is AI mode, it parses the audio type from the audio playback request, generates a configuration instruction based on the sound effect parameters of multiple channels corresponding to the audio type, and sends the configuration instruction to the audio processing chip. The audio processing chip sets the sound effect parameters of multiple channels and sends a parameter adjustment completion message to the controller 250. When the sound effect mode is detected to be movie mode, no modification to the sound effect parameters is required. The controller 250 receives the encoded audio stream input by the audio / video application, then decodes and performs primary separation on the encoded audio stream to obtain first audio data for multiple channels, and then sends the first audio data of multiple channels to the audio processing chip. The audio processing chip uses the set sound effect parameters to perform sound effect processing on the first audio data corresponding to the corresponding channel to obtain multiple second audio data, and then sends the multiple second audio data to the digital power amplifier corresponding to the corresponding channel. The digital power amplifier uses its own audio quality control parameters to process the received second audio data to obtain third audio data, which is then sent to the speaker of the corresponding channel. The speaker plays the audio from the received third audio data.
[0127] In some embodiments, when playing target audio, the controller 250 may further perform the following: real-time acquisition of equalization filter parameters for multiple preset frequency bands of the target audio; acquisition of the audio type of the target audio based on the equalization filter parameters for multiple preset frequency bands; and determination of whether the acquired audio type is the same as the previously acquired audio type. If the acquired audio type is different from the previously acquired audio type, a configuration command is generated and sent to the audio processing chip to configure the sound effect parameters corresponding to the acquired audio type for the channel.
[0128] In some embodiments, in response to an instruction to play target audio, the audio playback format is obtained. If the audio playback format is live streaming, the audio type of the target audio can be obtained in real time, and it can be determined whether the audio type has changed to decide whether to update the audio effect parameters corresponding to the channel. If the audio playback format is pre-recorded, it is not necessary to obtain the audio type of the target audio in real time, which can reduce resource consumption.
[0129] In some embodiments, while playing target audio, the controller 250 further performs the following: acquiring status data of multiple digital power amplifiers, including temperature and power. When the temperature of a digital power amplifier is detected to exceed a safe threshold, a command to reduce the maximum gain of the channel is sent to the digital power amplifier to reduce its output power.
[0130] When the power of the digital power amplifier is detected to exceed the rated value, a command to adjust the compression ratio of the dynamic range control is sent to the digital power amplifier to activate the transient limiter of the digital power amplifier, which is used to limit the audio output amplitude.
[0131] In some embodiments, the controller 250 can also detect the user's position via a camera or millimeter-wave radar. When a change in the user's position is detected, the equalization filter parameters of each channel are adjusted according to the user's current position, and the adjusted equalization filter parameters of each channel are sent to the digital power amplifier of the corresponding channel so that the digital power amplifier is configured with the corresponding equalization filter parameters.
[0132] In some embodiments, the timing diagram of the status monitoring and adjustment method can be as shown in Figure 13. The controller 250 queries the status register of each digital power amplifier every 100ms. The digital power amplifier collects status data and packages the status data, sending it to the controller 250. The status data includes the current temperature and current power. When the controller 250 detects that the temperature of a digital power amplifier is higher than a safe threshold, it sends a command to reduce the maximum gain of that channel to the digital power amplifier. The digital power amplifier adjusts the DRC threshold to reduce the output power and sends a protection adjustment confirmation message to the controller 250. When the controller 250 detects that the power of a digital power amplifier is higher than the rated value, it sends a command to adjust the compression ratio of the DRC to the digital power amplifier. The digital power amplifier activates the transient limiter to limit the audio output amplitude and sends a power protection activation confirmation message to the controller 250.
[0133] The controller 250 retrieves 30 PEQ parameters of the audio from the audio processing chip at regular intervals. It identifies the audio type based on these 30 PEQ parameters. When a change in the audio type is detected, it generates a configuration command based on the sound effect parameters of multiple channels corresponding to the changed audio type and sends the configuration command to the audio processing chip. The audio processing chip configures the sound effect parameters and sends a parameter adjustment completion message to the controller 250.
[0134] The controller 250 detects the user's position at regular intervals using a camera or millimeter-wave radar. When a change in the user's position is detected, it adjusts the equalization filter parameters for each channel based on the user's current position, and then sends the adjusted equalization filter parameters to the corresponding digital power amplifier. The digital power amplifier configures the adjusted equalization filter parameters and then sends a parameter update confirmation message to the controller 250.
[0135] In some embodiments, the timing diagram of the audio playback stop method can be as shown in Figure 14. The audio / video application sends a stop playback request to the controller 250. The controller 250 sends a stop audio processing instruction to the audio processing chip. The audio processing chip stops processing audio and sends a stop processing message to the controller 250. The controller 250 sends a mute instruction to the digital power amplifier. The digital power amplifier mutes the audio and sends a mute complete message to the controller 250.
[0136] In some embodiments, when the second mode where the audio processing chip is not enabled is in effect, the controller 250, in response to a command to play target audio, decodes the encoded data of the target audio to obtain multiple first audio data. The controller 250 can then send the multiple first audio data to a digital power amplifier via the audio processing chip. The audio processing chip does not perform any sound effect processing on the multiple first audio data; instead, it sends them directly to the corresponding digital power amplifier. Alternatively, the controller 250 can send each of the multiple first audio data directly to its respective digital power amplifier. The digital power amplifier can perform sound quality adjustment processing on the first audio data, or it can choose not to perform sound quality adjustment processing on the first audio data, and then send the unprocessed or processed first audio data to the corresponding speaker for playback.
[0137] The three-stage heterogeneous audio architecture of controller decoding, audio processing chip sound effect processing, and multiple digital power amplifier sound quality control in this embodiment has the following advantages: 1) Professional division of labor, restoring the accurate sound field of 5.1.2 channels. The controller efficiently completes source code decoding and separation, outputting a pure multi-channel PCM stream. The audio processing chip, with its powerful dedicated digital signal processing (DSP) computing power, focuses on running complex multi-channel object rendering algorithms and sound field reconstruction technology, accurately calculating and generating independent signals for each channel, including two sky channels, ensuring accurate positioning of sound objects in three-dimensional space, completely eliminating virtual and analog, and achieving true multi-channel output. 2) Independent amplification, completely eliminating crosstalk and ensuring channel separation. Each channel in the 5.1.2 system is equipped with an independent digital power amplifier for final amplification, physically isolating circuit interference between channels, achieving perfect electrical isolation, and ensuring the high independence of each channel signal. It also allows low-level signals such as rear surround sound and overhead channels to be driven clearly and powerfully, greatly improving the dynamic range and creating a truly immersive sound effect with a strong sense of immersion and height. 3) Fine-grained independent control to maximize the potential of the 5.1.2 system. This architecture allows for independent and personalized digital signal processing for 7 channels (5.1.2) + 1 subwoofer channel. High-frequency response is adjusted separately for the reflection characteristics of the overhead channels, vocal clarity is independently optimized for the center channel, and dynamics and limiting are managed separately for the subwoofer channel. Through this control of individual channels, not only can the differences between the hardware units themselves be compensated, but also the acoustic performance of each channel can be maximized according to its role in the 5.1.2 system, thereby elevating the sound performance of the entire true multi-channel system to a whole new level.
[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A display device, characterized in that, include: monitor; An audio processing chip used to support sound effect processing of multiple audio data corresponding to multiple channels; Multiple digital power amplifiers, each corresponding to a different channel, are used to perform sound quality control processing on the audio data of the corresponding channel output by the audio processing chip; multiple speakers, each corresponding to a different digital power amplifier, are used to play the audio data output by the corresponding digital power amplifier. The controller is configured to: after the display device is powered on, if it detects that the current mode is a first mode where the audio processing chip is enabled, generate a first configuration instruction and a plurality of second configuration instructions; the first configuration instruction includes a plurality of first sound effect parameters, each first sound effect parameter corresponding to a channel, and the first sound effect parameter is used to perform sound effect processing on the audio data of the corresponding channel; each second configuration instruction includes a sound quality control parameter corresponding to a channel, and the sound quality control parameter is used to perform sound quality control processing on the audio data of the corresponding channel; The audio processing chip is sent a first configuration instruction to configure the corresponding first sound effect parameter for the channel in response to the first configuration instruction; and the digital power amplifier is sent a second configuration instruction corresponding to the same channel to configure the corresponding sound quality control parameter in response to the second configuration instruction.
2. The display device according to claim 1, characterized in that, After sending the first configuration instruction to the audio processing chip and the second configuration instruction corresponding to the same channel to the digital power amplifier, the controller is further configured to: in response to an instruction to play target audio, decode the encoded data of the target audio to obtain a plurality of first audio data, each of the first audio data corresponding to one channel; and transmit the plurality of first audio data to the audio processing chip. The audio processing chip is configured to: after receiving the plurality of first audio data, perform sound effect processing on the first audio data corresponding to the corresponding channel using the plurality of first sound effect parameters to obtain a plurality of second audio data; transmit the plurality of second audio data to the digital power amplifier of the corresponding channel respectively; the plurality of digital power amplifiers are configured to: after receiving the second audio data, perform sound quality control processing on the second audio data using the configured sound quality control parameters to obtain third audio data; transmit the third audio data to the corresponding speaker; the plurality of speakers are configured to: play the third audio data after receiving the third audio data.
3. The display device according to claim 1, characterized in that, After the display device is powered on, if the controller detects that it is currently in a first mode where the audio processing chip is enabled, it generates a first configuration instruction, which is further configured to: obtain the currently set sound effect mode; if the currently set sound effect mode is the first sound effect mode, obtain the first audio type corresponding to the first sound effect mode, and determine multiple first sound effect parameters corresponding to the first audio type based on the correspondence between the audio type and the sound effect parameters; generate the first configuration instruction based on the multiple first sound effect parameters; or, if the currently set sound effect mode is the second sound effect mode, read the initially set second audio type. Based on the correspondence between audio type and sound effect parameters, a plurality of first sound effect parameters corresponding to the second audio type are determined; based on the plurality of first sound effect parameters, the first configuration instruction is generated.
4. The display device according to claim 2, characterized in that, The controller is further configured to: in response to an instruction to play target audio, if the currently set sound effect mode is a second sound effect mode, obtain the audio type of the target audio; based on the correspondence between audio type and sound effect parameters, determine a plurality of second sound effect parameters corresponding to the audio type of the target audio, each second sound effect parameter corresponding to a channel; generate a third configuration instruction based on the plurality of second sound effect parameters; and send the third configuration instruction to the audio processing chip; the audio processing chip is further configured to: in response to the third configuration instruction, replace the currently configured sound effect parameters of the channel with the corresponding second sound effect parameters; and after receiving the plurality of first audio data, perform sound effect processing on the first audio data corresponding to the corresponding channel using the plurality of second sound effect parameters to obtain a plurality of second audio data.
5. The display device according to claim 4, characterized in that, The controller executes a command in response to play the target audio. When the currently set sound effect mode is the second sound effect mode, it obtains the audio type of the target audio. It is further configured to: in response to a command to play the target audio, when the currently set sound effect mode is the second sound effect mode, obtain the equalization filter parameters of the preset multiple frequency bands of the target audio. The audio type of the target audio is obtained based on the preset equalization filter parameters for multiple frequency bands.
6. The display device according to claim 2, characterized in that, During the playback of the target audio, the controller is further configured to: acquire status data of multiple digital power amplifiers, the status data including temperature and power; when the temperature of a digital power amplifier is detected to exceed a safety threshold, send a command to reduce the maximum gain of the channel to the digital power amplifier to reduce the output power of the digital power amplifier; when the power of a digital power amplifier is detected to exceed a rated value, send a command to adjust the compression ratio of the dynamic range control to the digital power amplifier to activate the transient limiter of the digital power amplifier, the transient limiter being used to limit the audio output amplitude.
7. The display device according to claim 1, characterized in that, After the display device is powered on, if the controller detects that it is currently in the first mode where the audio processing chip is enabled, it generates multiple second configuration instructions, which are further configured to: read multiple frequency response calibration data from the factory settings file, each of the frequency response calibration data corresponding to a channel; and calculate the equalization filter parameters of the corresponding channel based on the multiple frequency response calibration data. Generate multiple second configuration instructions, each of which includes equalization filter parameters corresponding to one channel.
8. The display device according to claim 1, characterized in that, After the display device is powered on, if the controller detects that it is currently in a first mode where the audio processing chip is enabled, it generates multiple second configuration instructions, which are further configured to: calculate multiple delays based on the distance between the multiple speakers and the user's position, each delay corresponding to a channel; and generate multiple second configuration instructions, each second configuration instruction including a delay corresponding to a channel.
9. The display device according to claim 1, characterized in that, After the display device is powered on, if the controller detects that it is currently in the first mode where the audio processing chip is enabled, it generates multiple second configuration instructions, which are further configured to: read multiple sets of protection parameters from the factory settings file, each set of protection parameters corresponding to one channel, and the protection parameters being a pre-set safety threshold to prevent damage to the digital power amplifier; Based on the multiple sets of protection parameters, the dynamic range control parameters of the corresponding channels are calculated respectively; multiple second configuration instructions are generated, each of which includes the dynamic range control parameters corresponding to one channel.
10. A method for configuring audio processing parameters, characterized in that, An application is made in a display device, the display device including a display, an audio processing chip, multiple digital power amplifiers, and multiple speakers; the audio processing chip is used to support sound effect processing of multiple audio data corresponding to multiple channels; different digital power amplifiers correspond to different channels; the digital power amplifiers are used to perform sound quality control processing on the audio data of the corresponding channel output by the audio processing chip; different speakers correspond to different digital power amplifiers, and the speakers are used to play the audio data output by the corresponding digital power amplifier; the method includes: after the display device is powered on, if it is detected that it is currently in a first mode where the audio processing chip is enabled, generating a first configuration instruction and multiple second configuration instructions; The first configuration instruction includes a plurality of first sound effect parameters, each first sound effect parameter corresponding to a channel, and the first sound effect parameter is used to perform sound effect processing on the audio data of the corresponding channel; each second configuration instruction includes a sound quality control parameter corresponding to a channel, the sound quality control parameter being used to perform sound quality control processing on the audio data of the corresponding channel; the first configuration instruction is sent to the audio processing chip so that the audio processing chip, in response to the first configuration instruction, configures the corresponding first sound effect parameter for the channel; and the second configuration instruction corresponding to the same channel is sent to the digital power amplifier so that the digital power amplifier, in response to the second configuration instruction, configures the corresponding sound quality control parameter.