Display device and audio processing method

Abstract

This application discloses a display device and an audio processing method. After the display device establishes a stable connection with the audio peripheral through the peripheral interface, it actively acquires and parses the audio processing parameters such as the decoding capability and number of channels of the audio peripheral. Combined with a preset strategy, it accurately matches the applied audio data with the peripheral parameters to generate an output configuration suitable for the audio peripheral to play the audio data. Then, it processes and sends the audio data, realizing the adaptive adaptation between the audio peripheral and the audio data, and improving the stability of the audio output and the user experience.

Description

Technical Field

[0001] This application relates to the field of display devices, and more particularly to a display device and an audio processing method. Background Technology

[0002] As the application scenarios of large-screen display devices such as smart TVs continue to expand, these devices can connect to a variety of audio peripherals, such as Bluetooth headphones, Bluetooth speakers, soundbars, and home theaters. The decoding capabilities and number of channels supported by different audio peripherals vary significantly.

[0003] Taking smart TVs as an example, their audio decoding chips, amplifiers, and output interfaces are all factory-configured, supporting a limited number of audio formats, including PCM. Due to the limitations of their internal audio hardware capabilities, existing audio policies (such as Audio Policy) only support fixed format output and simple routing switching. When the audio output configuration is incompatible with audio peripherals, the smart TV still uses direct pass-through or forced conversion to output, which can easily lead to noise, distortion, or no sound, resulting in a reduced listening experience for the user. Summary of the Invention

[0004] This application provides a display device and an audio processing method that can solve the technical problems of poor compatibility of display devices with connected audio peripherals and unreasonable format matching leading to abnormal audio playback such as noise, distortion, and no sound.

[0005] In a first aspect, a display device is provided, including a display, a peripheral interface, and a controller. The peripheral interface is configured to communicate with one or more audio peripherals and output audio. The controller is configured to: upon establishing an audio communication connection with a first audio peripheral, acquire the audio processing capability of the first audio peripheral; the audio processing capability of the first audio peripheral is used to indicate relevant parameters that the first audio peripheral supports for audio playback; parse the audio processing capability of the first audio peripheral to obtain a first parameter supported by the first audio peripheral, the first parameter including decoding capability, number of channels, and audio metadata; when audio data of a first application is output through the first audio peripheral, match the audio data with the first parameter based on a preset strategy to obtain an output configuration for audio data matching; process the audio data based on the output configuration, and send the processed data to the first audio output.

[0006] Decoding capability is the collection of various audio codecs that the first audio peripheral supports for decoding. Decoding capability can be presented through a list of audio codecs supported by the audio peripheral, covering audio encoding formats that can be decoded at both the hardware and software levels of the first audio peripheral.

[0007] The process of matching audio data with the first parameter based on a preset strategy. The display device uses the preset strategy as a guideline to compare the core attributes of the audio data, such as the encoding format, channel specifications, and fidelity level, with parameters such as the decoding capability, channel support, and hardware compatibility of the first audio peripheral, and selects the output configuration that matches the audio data to ensure that the audio data is compatible with the first audio peripheral.

[0008] After the display device provided in this application establishes a stable connection with the audio peripheral through the peripheral interface, the controller actively acquires and parses the audio processing parameters such as the decoding capability and number of channels of the audio peripheral. Combined with the preset strategy, the application audio data and peripheral parameters are accurately matched to generate an output configuration suitable for the audio peripheral to play audio data. Then, the audio data is processed and sent, realizing the adaptive adaptation between the audio peripheral and the audio data, and improving the stability and user experience of the audio output.

[0009] In one possible implementation, the controller performs a matching operation between audio data and a first parameter based on a preset strategy to obtain an output configuration matching the audio data. It is further configured to: determine the target audio decoding capability corresponding to the first audio peripheral based on the first parameter, whereby the target audio decoding capability indicates the highest level of audio decoding specifications supported by the first audio peripheral; if the display device is not configured with user preferences, determine a first output configuration matching the audio data based on the target audio decoding capability. If the display device is configured with user preferences, and if the target audio decoding capability supports the audio parameters corresponding to the user preferences, then determine a second output configuration matching the audio data based on the target audio decoding capability and the user preferences; if the target audio decoding capability does not support the audio parameters corresponding to the user preferences, then determine a third output configuration matching the audio data based on the support range of the target audio decoding capability itself.

[0010] The display device determines the output configuration of the audio data through this layered matching preset strategy, which follows the hardware decoding specifications of the audio peripherals and also takes into account the personalized needs of users. Ultimately, it achieves an output configuration that is highly adapted to the audio data, ensuring the stability and sound quality of the audio output.

[0011] In one possible implementation, where the first audio peripheral is an audio device that establishes a connection with the display device via an HDMI audio interface or Wi-Fi, the audio decoding capability corresponding to the first audio peripheral determined by the controller includes one of Dolby Metadata Enhanced Audio Transmission Decoding Capability, Dolby Atmos Decoding Capability, Dolby Digital Decoding Capability, or Pulse Code Modulation Decoding Capability.

[0012] After the TV system starts up, the display device automatically obtains and analyzes the audio processing capabilities of the audio peripherals through the peripheral detection service. It evaluates the decoding specifications level by level based on eARC support, accurately determines the compatibility capabilities of Dolby MAT, Dolby Atmos, Dolby Digital Plus, etc., and synchronizes them to various audio applications. At the same time, it executes audio output strategies based on the matching relationship between user preferences and the decoding capabilities of audio peripherals. This ensures the compatibility between audio output and audio peripheral hardware specifications, while also taking into account the personalized needs of users under the premise of compatibility, thereby achieving the stability of audio output and sound quality optimization.

[0013] In one possible implementation, when the first audio peripheral device is an audio device that establishes a connection with the display device via Bluetooth or a USB interface, the controller determines that the audio decoding capability corresponding to the first audio peripheral device includes one of two-channel pulse code modulation decoding capability and multi-channel linear pulse code modulation decoding capability.

[0014] After the display device starts up, the peripheral detection service uses a capability detection engine to obtain and analyze the audio processing capabilities of audio peripherals when they are connected via Bluetooth. First, it determines the LPCM or PCM decoding capability based on multi-channel support. Then, it executes differentiated transcoding and output strategies based on whether Bluetooth virtual surround sound is supported. If supported, it transcodes to LPCM containing spatial metadata and simulates Dolby Atmos listening through algorithms. If not supported, it outputs dual-channel PCM data. The entire process matches the audio format based on the audio peripheral's decoding capability to ensure the compatibility of audio output with the audio peripheral. This can optimize the spatial sound effect experience and sound quality output in Bluetooth or USB connection scenarios.

[0015] This application is for applications using HDMI / Wi-Fi The controller connects to different audio peripherals via Fi and Bluetooth / USB. It employs differentiated decoding capability determination logic to support Dolby series multi-channel encoding and common audio formats such as PCM / LPCM, thereby improving the compatibility of different peripherals.

[0016] In one possible implementation, the preset strategy includes the compatibility of audio data with the first audio peripheral; the matching degree of user preferences with audio decoding capabilities; and the fidelity of the audio data.

[0017] In one possible implementation, after the controller parses the audio processing capabilities of the first audio peripheral and obtains the first parameters supported by the first audio peripheral, it is further configured to: write the first parameters supported by the first audio peripheral into a preset configuration file to obtain a capability configuration file; store the capability configuration file in a system-level data sharing component; and allow the data in the system-level data sharing component to be accessed by the first application. This enables the first application to directly access the data, avoids redundant detection, and improves system operating efficiency.

[0018] In one possible implementation, the controller is further configured to: when establishing an audio communication connection with the second audio peripheral, acquire the audio processing capabilities of the second audio peripheral, and determine the second parameters supported by the second audio peripheral, the second parameters including decoding capabilities, number of channels and audio metadata; and write the second parameters supported by the second audio peripheral into the capability configuration file.

[0019] When the controller executes the first audio data of the first application is output through the first audio peripheral, and matches the first audio data with the first parameter based on a preset strategy to obtain the output configuration matching the first audio data, it is also configured to: when the second audio data of the second application is output through the second audio peripheral, match the second audio data with the second parameter based on a preset strategy to obtain the output configuration matching the second audio data.

[0020] This solution can be extended to multi-window display scenarios on display devices (such as the first window and the second window being tiled), with different windows carrying different application content: the first window runs the first application and plays the first audio data, and the second window runs the second application and plays the second audio data.

[0021] To provide users viewing the first window and users viewing the second window with independent and high-quality audio experience, the display device will perform independent matching processing for the audio data of each window: when the first audio data is output through the first audio peripheral, it will be matched with the first parameter and the preset strategy to generate an appropriate output configuration; when the second audio data is output through the second audio peripheral, it will be matched with the second parameter and the preset strategy to generate an appropriate output configuration.

[0022] In a second aspect, an audio processing method is provided, applied to a display device of the first aspect. The display device includes a first application for playing audio data. The method includes: when establishing an audio communication connection with a first audio peripheral, acquiring the audio processing capability of the first audio peripheral; the audio processing capability of the first audio peripheral is used to indicate relevant parameters that the first audio peripheral supports for audio playback; parsing the audio processing capability of the first audio peripheral to obtain a first parameter supported by the first audio peripheral, the first parameter including decoding capability, number of channels, and audio metadata; when audio data of the first application is output through the first audio peripheral, matching the audio data with the first parameter based on a preset strategy to obtain an output configuration matching the audio data; processing the audio data based on the output configuration, and sending the processed data to the first audio output.

[0023] Thirdly, an audio processing apparatus is provided, including a unit for performing any of the audio processing methods in the second aspect. This apparatus may be a terminal device or a chip within a terminal device.

[0024] Fourthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by an audio processing device, causes the audio processing device to perform any of the audio processing methods described in the first aspect.

[0025] Fifthly, a computer program product is provided, comprising: a computer program that, when the computer program audio processing device is run, causes the audio processing device to perform any of the audio processing methods in the first aspect.

[0026] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0027] Figure 1 This illustration shows a scenario diagram of audio output from a display device according to an embodiment of this application; Figure 2 A configuration block diagram of a display device provided in an embodiment of this application is shown; Figure 3 A system block diagram of a display device provided in an embodiment of this application is shown; Figure 4 The flowcharts of some embodiments of the audio processing methods provided in this application are shown; Figure 5 A flowchart of an audio processing method provided in some embodiments of this application is shown; Figure 6 A flowchart of an audio processing method provided in some embodiments of this application is shown; Figure 7 A flowchart of an audio processing method provided in some embodiments of this application is shown; Figure 8 The following are schematic diagrams illustrating application scenarios of the audio processing methods provided in some embodiments of this application; Figure 9 Timing diagrams of audio processing methods provided in some embodiments of this application are shown; Figure 10 A schematic diagram of an audio processing apparatus provided in some embodiments of this application is shown. Detailed Implementation

[0028] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0029] It should be understood that "multiple" as mentioned in this application refers to two or more. In the description of this application, unless otherwise stated, " / " indicates "or," for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist, for example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, to facilitate a clear description of the technical solutions of this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and that "first," "second," etc., do not necessarily imply differences.

[0030] To facilitate understanding of the embodiments of this application, the relevant terms such as audio strategy, audio format, and audio metadata involved in the embodiments of this application will be introduced first.

[0031] (1) Audio Policy: This is a key component in the Android system responsible for managing audio sessions and audio routing. Audio Policy manages the audio streams of applications by creating, activating, and closing audio sessions. Each audio session represents an application or an audio stream.

[0032] (2) Audio Format: refers to the audio encoding / encapsulation method, which is the storage / transmission format of audio data.

[0033] (3) Audio Metadata: This refers to the additional data embedded in the audio stream. It does not contain any audible audio signals and is only used to define and control the rendering rules and playback methods of the audio. Audio metadata includes spatial metadata and control metadata.

[0034] Spatial metadata is used to achieve 3D spatial sound rendering, such as the location, movement path, and height channel information of Dolby Atmos sound objects. Control metadata is used to regulate the dynamic performance and playback adaptation of audio, including dynamic range control, loudness parameters, mixing rules, and multi-channel backward compatibility strategies.

[0035] Before providing a detailed explanation of the display device and audio processing method provided in the embodiments of this application, the application scenarios and related technologies of the display device and audio processing method will be explained first.

[0036] As the application scenarios of large-screen display devices such as smart TVs continue to expand, these devices can connect to a variety of audio peripherals, such as Bluetooth headphones, Bluetooth speakers, soundbars, and home theaters. The decoding capabilities and number of channels supported by different audio peripherals vary significantly.

[0037] Taking a smart TV (Android) as an example, its audio decoding chip, power amplifier, and output interface are all factory-configured, and the applicable scenarios (such as connecting to a set-top box, playing local videos, screen casting, etc.) support a limited number of audio formats, including PCM. Due to the limitations of its internal audio hardware capabilities, the existing Audio Policy only supports fixed format output and simple routing switching, and cannot be flexibly adjusted according to the capabilities of audio peripherals.

[0038] Current smart TVs' audio policies cannot dynamically adapt to the capabilities of audio peripherals in real time. When the audio output configuration is incompatible with the audio peripheral, the smart TV outputs audio data using direct pass-through or forced conversion methods, which can easily lead to playback problems such as silence, noise, popping sounds, and abnormal channels. This cannot guarantee stable, high-quality audio playback and affects the user's listening experience.

[0039] In view of this, this application provides a display device and an audio processing method. After the display device establishes a stable connection with the audio peripheral through the peripheral interface, it actively acquires and parses the audio processing parameters such as the decoding capability and number of channels of the audio peripheral. Combined with a preset strategy, it accurately matches the application audio data with the peripheral parameters to generate an output configuration suitable for the audio peripheral to play the audio data. Then, it processes and sends the audio data, realizing the adaptive adaptation between the audio peripheral and the audio data, and improving the stability of the audio output and the user experience.

[0040] The display device provided in this application can have various implementation forms, such as a television, a smart television, a projection device, a monitor, an electronic bulletin board, etc. The display device can output audio data through audio peripherals.

[0041] Figure 1 This application provides an embodiment of a scenario illustrating the audio output of a display device. Figure 1 As shown, display device 200 can connect to various audio peripherals, such as Bluetooth headphones, soundbars, and home theater systems. Different audio peripherals support significant differences in decoding capabilities and the number of channels, thus expanding the usage scenarios for large-screen display devices such as smart TVs.

[0042] A soundbar, also known as a soundbar, is an audio device that integrates multiple channel speakers and an amplifier into a single long, rectangular enclosure. A home theater is a playback system designed to reproduce cinematic audiovisual effects in a home environment, consisting of an audio / video player, an AV amplifier, and speakers.

[0043] Audio peripherals can also be audio devices that support HDMI Audio Return Channel (ARC) or Enhanced Audio Return Channel (eARC), audio devices that support USB Digital-to-Analog Converter (USB DAC), etc.

[0044] Audio devices that support HDMI ARC / eARC: These are audio devices that can receive and play audio signals from devices such as TVs, and can achieve audio return and output through the HDMI audio interface. Examples include soundbars and home theaters.

[0045] Audio devices that support USB DAC: These are decoding and playback devices equipped with a USB digital-to-analog converter module that can convert USB digital audio signals into analog signals to drive headphones or speakers to produce sound, such as portable decoding headphones and desktop USB speakers.

[0046] It should be noted that users can operate the display device through smart devices or control devices. The control device can be a remote control, and communication between the remote control and the display device includes infrared or Bluetooth communication, as well as other short-range communication methods, controlled wirelessly or via wired connections. Users can control the display device by inputting user commands through buttons on the remote control, voice input, or control panel input. Smart devices can be mobile terminals, tablets, computers, laptops, etc.

[0047] In some embodiments, the display device may also receive user control via touch or gesture, or directly receive user voice command control via a module configured inside the display device for acquiring voice commands, or receive user voice command control via a voice control device set outside the display device.

[0048] In some embodiments, the display device also communicates with the server. The display device may be allowed to communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server can provide various content and interactive features to the display device. The server can be a cluster or multiple clusters, and may include one or more types of servers.

[0049] Figure 2A configuration block diagram of a display device provided in an embodiment of this application is shown, such as... Figure 2 As shown, the display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user interface.

[0050] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0051] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0052] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0053] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0054] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0055] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0056] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0057] In some embodiments, the audio output device 270 may be the native speaker of the display device 200 or an external audio output device (i.e., an audio peripheral) connected to the display device 200.

[0058] The display device 200 may also be provided with an audio output interface, which may include at least one of an analog audio interface, a USB audio interface, an HDMI audio interface, and an optical fiber interface. Audio peripherals can be connected to the display device 200 through such an audio output interface to transmit audio data to the audio peripherals for playback via a wired connection.

[0059] In addition, the display device 200 can also establish an audio communication connection and audio output with the audio peripheral through the Bluetooth module, Wi-Fi module or Ethernet module in the communicator 220, and wirelessly transmit the audio signal to the audio peripheral for playback.

[0060] The aforementioned communicator and audio output interface can be summarized as a peripheral interface, which is configured to communicate with and output audio to one or more audio peripherals.

[0061] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0062] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0063] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0064] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), random access memory (RAM), read-only memory (ROM), a first to an nth interface for input / output, a communication bus, etc.

[0065] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0066] A user interface (GUI) is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of GUI is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0067] like Figure 3 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0068] In some embodiments, at least one application for playing audio data runs in the application layer. These applications can be programs that come with the operating system or applications developed by third-party developers. In specific implementations, the applications in the application layer may be, for example, a first application and a second application, wherein the audio data output by the first application is first audio data, and the audio data output by the second application is second audio data.

[0069] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0070] In this embodiment of the application, the application framework layer may include a peripheral detection service 310, a capability detection engine 320, a dynamic decision engine 330, a system-level data sharing component (Content Provider) 340, and an audio policy service 350.

[0071] The peripheral detection service 310 is used to detect the connection of audio peripherals, identify the device type (which is mainly used to describe the connection method of the audio peripherals) and connection status (such as connecting or connected), and synchronize the device type to the capability detection engine 320.

[0072] It should be noted that the peripheral detection service 310 starts after the display device is turned on.

[0073] The capability detection engine 320 is used to receive the device type of the audio peripheral sent by the peripheral detection service 310, and obtain the audio processing capability of the audio peripheral according to the standard protocol corresponding to the device type, that is, the relevant parameters of the audio peripheral that it supports audio playback. The relevant parameters include decoding data, number of channels, audio metadata, transmission rate and bandwidth, sampling rate and other parameters.

[0074] When the audio peripheral device type is a Bluetooth audio device, the corresponding standard protocol is the Advanced Audio Distribution Profile (A2DP), which is used to control the distribution of audio data. When the Bluetooth audio device receives a codec capability query request sent by the display device, it can return a list of codecs supported by the audio device itself, as well as the core parameters of each codec (sampling rate, bit depth, number of channels, maximum bit rate, etc.).

[0075] When the audio peripheral device type is an audio device that supports HDMI ARC / eARC, its corresponding control protocol is Consumer Electronics Control (CEC). Furthermore, in some embodiments, the audio format support of audio devices that support HDMI ARC / eARC can also be reported to the display device via the Short Audio Descriptor (SAD) in the Extended Display Identification Data (EDID).

[0076] When the audio peripheral device type is an audio device that supports a USB DAC, its corresponding standard protocol is USB Audio Class (UAC). The display device can read the UAC descriptor set of the audio device that supports a USB DAC, thereby obtaining the audio control functions, supported audio formats, sampling rate, number of channels, etc. of the audio device that supports a USB DAC.

[0077] When the audio peripheral device type is a wireless network connection (such as a Wi-Fi connection), the corresponding driver can use the Display Data Channel (DDC) to obtain the audio capability structure data that characterizes the audio processing capability of the audio peripheral. The audio capability structure data can be in EDID format.

[0078] When the interface type of the audio peripheral is a built-in speaker, the corresponding audio policy is Audio policy.

[0079] The dynamic decision engine 330 receives the audio processing capabilities of the audio peripherals sent by the capability detection engine 320, selects the required target parameters (including decoding capabilities, number of channels, and audio metadata) from them, generates a capability configuration file, and writes it to the ContentProvider 340.

[0080] ContentProvider340 is a core component provided by the Android system for secure data sharing between different applications. It enables cross-application data reading and writing through a unified URI access mechanism and is used to store capability configuration files determined by the dynamic decision engine 330.

[0081] Audio policy service 350 is used to receive audio playback requests from upper-layer applications (first application, second application), obtain the target parameters (such as first parameter, second parameter) of the audio peripheral from the capability configuration file of ContentProvider 340, match the audio data played by the first application or / and the second application with the target parameters of the target audio peripheral to obtain the audio data matching output configuration, and output the processed audio data through peripheral detection service 310.

[0082] It should be noted that the audio policy service can be deployed at the framework layer for all applications to call to obtain the target parameters of the audio peripheral; or it can be integrated into each application, and only the application itself can call and obtain the target parameters of the audio peripheral.

[0083] The application framework layer may also include managers, which include at least one of the following modules: Activity Manager, used to interact with all activities running on the system; Location Manager, used to provide system services or applications with access to system location services; Package Manager, used to retrieve various information related to application packages currently installed on the device; Notification Manager, used to control the display and clearing of notification messages; and Window Manager, used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0084] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0085] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0086] The kernel layer is the layer between hardware and software. The kernel layer may include at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0087] The hardware layer may include a USB audio interface, a Bluetooth module, an HDMI audio interface, a Wi-Fi module, built-in speakers, and an analog audio interface. The display device can communicate with audio peripherals, acquire / decode / play audio signals, and coordinate audio-video links through the chips corresponding to these interfaces or modules.

[0088] The HDMI audio interface (HDMI ARC / eARC) reuses the TMDS and DDC channels of the HDMI data cable and is paired with a dedicated HDMI audio transceiver chip to support bidirectional audio transmission. HDMI ARC / eARC serves as the audio-visual interaction interface between the display device and the audio peripheral. The display device receives the EDID-related configuration of the audio peripheral through this interface and forwards the decoded audio signal to the audio peripheral.

[0089] The USB audio interface integrates a USB PHY chip and a UAC codec, is compatible with USB audio standards, and enables digital transmission and reproduction of audio signals.

[0090] The analog audio interface (3.5mm audio interface) integrates a digital-to-analog converter (DAC) chip. The display device converts the digital audio signal into an analog signal via the DAC and then outputs it directly through this interface.

[0091] For illustrative purposes and not for limiting purposes, specific details such as particular system structures and modules have been presented to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application can also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, and circuits have been omitted to avoid unnecessary detail from hindering the description of this application.

[0092] To facilitate a further understanding of the technical solutions in some embodiments of this application, the audio processing solution applied to the aforementioned display device, and how this technical solution solves the above-mentioned technical problems, will be described in detail below with reference to specific embodiments and accompanying drawings. The embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.

[0093] Figure 4 Flowcharts of audio processing methods provided in some embodiments of this application are shown, such as... Figure 4 As shown, the display device or the controller of the display device is configured to perform the following steps S410 to S440, which will be explained using a television as an example.

[0094] S410. When the display device establishes an audio communication connection with the first audio peripheral, the audio processing capability of the first audio peripheral is obtained.

[0095] The audio processing capability is used to indicate the relevant parameters that the first audio peripheral supports for audio playback. These relevant parameters include decoded data, number of channels, audio metadata, transmission rate and bandwidth, sampling rate, and other parameters.

[0096] When the display device establishes an audio communication connection with the first audio peripheral (i.e., the connection is completed and the device is in a connected state), it actively sends a capability query request to the first audio peripheral. The first audio peripheral returns information on the audio processing functions it supports, including decoding data, number of channels, audio metadata, transmission rate and bandwidth, sampling rate, etc.

[0097] S420: The display device analyzes the audio processing capabilities of the first audio peripheral to obtain the first parameters supported by the first audio peripheral. The first parameters include decoding capabilities, number of channels, and audio metadata.

[0098] The display device analyzes the acquired audio processing capabilities of the first audio peripheral to obtain the first parameters related to audio data output supported by the first audio peripheral, namely decoding capability, number of channels, and audio metadata.

[0099] Among them, decoding capability is the collection of various audio codecs supported by the first audio peripheral. Decoding capability can be presented through the list of audio codecs supported by the audio peripheral, covering the audio encoding formats that can be decoded at both the hardware and software levels of the first audio peripheral.

[0100] It should be noted that a single audio device can possess multiple decoding capabilities, and each decoding capability has a preset priority; this priority can be configured by the display device or directly provided by the audio peripheral. For example, the priority order is: Dolby Metasonic Enhanced Audio Transport (Dolby MAT) is higher than Dolby Atmos, higher than Dolby Digital Plus, higher than Dolby Digital, and finally higher than Pulse Code Modulation (PCM).

[0101] The number of channels refers to the number of channels supported by an audio device, such as 2.0 channels, 5.1 channels, 7.1 channels, 5.1.2 channels, and 7.1.4 channels. Among them, 5.1.2 and 7.1.4 are multi-channel configuration formats exclusive to Dolby Atmos, which add height channels to the traditional 5.1 / 7.1 channels.

[0102] Audio metadata refers to additional data embedded in an audio stream, including spatial metadata and control metadata. Examples include Dolby Atmos metadata and Dolby metadata.

[0103] Dolby Atmos metadata is used to describe audio spatial information, including Dolby spatial information such as 3D positioning, height, and objects. Dolby metadata is also used to describe audio control information, including Dolby basic control information such as volume, dynamics, and loudness.

[0104] When an audio communication connection is established between the display device and the first audio peripheral, the first parameter will be stored in the display device. This will facilitate the use of the first parameter for data analysis, such as matching, when audio data from various applications is output through the first audio peripheral.

[0105] S430, when the audio data of the first application is output through the first audio peripheral, the display device matches the audio data with the first parameter based on a preset strategy to obtain an output configuration that matches the audio data.

[0106] The audio data of the first application is output through the first audio peripheral. This output method can be manually set by the user or automatically selected by the system when the display device is connected to only a single audio peripheral.

[0107] Preset strategies may include compatibility between audio data and the first audio peripheral; the matching degree between user preferences and audio decoding capabilities; and the fidelity of the audio data. Preset strategies may also include compatibility between audio data and the first audio peripheral.

[0108] The process of matching audio data with the first parameter based on a preset strategy. The display device uses the preset strategy as a guideline to compare the core attributes of the audio data, such as the encoding format, channel specifications, and fidelity level, with parameters such as the decoding capability, channel support, and hardware compatibility of the first audio peripheral, and selects the output configuration that matches the audio data to ensure that the audio data is compatible with the first audio peripheral.

[0109] The default strategy prioritizes compatibility, matching audio data with the hardware / software compatibility of the primary audio peripheral. It only uses encoding formats and channel configurations supported by the peripheral to avoid decoding failures and no sound output. Furthermore, it considers user preferences for sound quality and channel effects, prioritizing audio data fidelity while meeting the decoding capabilities of the audio peripheral, and also taking into account the user's personalized listening needs.

[0110] S440, The display device processes the audio data based on the output configuration and sends the processed data to the first audio output.

[0111] The audio processing method provided in this application embodiment displays that after the device establishes a stable connection with the audio peripheral through the peripheral interface, it actively acquires and parses the audio processing parameters such as the decoding capability and number of channels of the audio peripheral. Combined with a preset strategy, it accurately matches the applied audio data with the parameters of the audio peripheral to generate an output configuration suitable for the audio peripheral to play the audio data. Then, it processes and sends the audio data, realizing the adaptive adaptation between the audio peripheral and the audio data, and improving the stability and user experience of the audio output.

[0112] Based on the audio processing scheme introduced above, when the display device establishes an audio communication connection with the first audio peripheral in step S410, during the process of obtaining the audio processing capability of the first audio peripheral, the device type of the first audio peripheral can also be obtained, and the audio processing capability of the audio peripheral can be obtained according to the protocol corresponding to the device type, etc. The following will provide supplementary explanation.

[0113] When the display device establishes an audio communication connection with the first audio peripheral, the peripheral detection service in the display device can obtain the device type of the first audio peripheral and obtain the audio processing capability of the audio peripheral according to the protocol corresponding to the device type.

[0114] The device type is mainly used to identify the connection method of audio peripherals, such as Bluetooth connection, HDMI audio interface connection, USB audio interface connection, etc.

[0115] Display devices employ differentiated methods for acquiring audio processing capabilities based on different connection methods for audio peripherals. The capability detection engine within the display device can query and acquire audio processing capabilities based on the standard or custom protocols corresponding to the connection.

[0116] For example, a Bluetooth-connected audio device (i.e., a Bluetooth audio device) can receive a capability query request from a display device via the A2DP protocol and return a list of codecs it supports, along with parameters such as sampling rate, bit depth, number of channels, and maximum bit rate for each codec. Audio devices connected via HDMI ARC / eARC report their audio processing capabilities to the display device via protocols such as CEC. Audio devices connected via USB report their UAC descriptor set to the display device, allowing the display device to obtain the audio device's audio control functions, supported audio formats, sampling rate, number of channels, etc.

[0117] It should be understood that during the process of establishing a communication connection with the first audio peripheral, the display device can also obtain the connection status between the first audio peripheral and the display device. This connection status is used to describe the connection status between the first audio device and the display device, including the connected status and the connection in progress status.

[0118] The audio processing method provided in this application embodiment enables the display device to accurately and efficiently acquire the audio processing capabilities of audio peripherals with different connection methods by identifying the type of audio peripheral device and using differentiated protocol adaptation, thereby improving the compatibility and adaptation flexibility between the display device and the audio peripheral.

[0119] Based on the audio processing scheme described above, after executing step S420, the display device parses the audio processing capabilities of the first audio peripheral and obtains the first parameters supported by the first audio peripheral. Then, the first parameters supported by the first audio peripheral can be written into a preset configuration file to obtain a capability configuration file. The capability configuration file is then stored in the Content Provider, and the data in the Content Provider can be called by the first application.

[0120] The first parameter of the first audio peripheral is written into the capability configuration file and stored in the Content Provider. Relying on the cross-application data sharing feature of the Content Provider, the standardized storage and secure sharing of audio peripheral capability parameters are realized, allowing various applications to easily call the parameters, avoiding repeated parsing of the audio processing capabilities of the audio peripheral, improving the audio adaptation efficiency of the Android system, and ensuring the security and consistency of application parameter calls.

[0121] Based on the audio processing scheme introduced above, when the audio data of the first application is output through the first audio peripheral in step S430, the display device matches the audio data with the first parameter based on a preset strategy to obtain the output configuration of the matched audio data. In the process, it can also determine the audio decoding capability of the first audio peripheral, user preferences, etc., which will be further explained below.

[0122] Figure 5 Flowcharts of audio processing methods provided in some embodiments of this application are shown, such as... Figure 5 As shown, the display device or the controller of the display device is configured to perform the following steps S431 to S433, which will be explained using a television as an example.

[0123] S431. Based on the first parameter, determine the target audio decoding capability corresponding to the first audio peripheral. The target audio decoding capability is used to indicate the highest level of audio decoding specification that the first audio peripheral can support.

[0124] The display device first obtains the list of audio codecs supported by the first audio peripheral, filters and matches the target audio decoding capability corresponding to the current audio data. This audio decoding capability is used to indicate the highest level of audio decoding specification that the first audio peripheral can support, so as to better ensure that the audio data output configuration is compatible with the audio peripheral decoding specification in the subsequent audio output matching process and improve the audio output quality.

[0125] The audio codec list may include all levels of audio decoding capabilities supported by the first audio peripheral.

[0126] Based on step S431 above, the display device will determine the appropriate output configuration according to the scenario, depending on whether user preferences are configured, as follows: S432. If the display device is not configured with user preferences, determine a first output configuration that matches the audio data based on the target audio decoding capability.

[0127] When the display device does not have user-defined audio preference settings (such as sound quality, channels, sound effects, etc.), the matching process is based solely on the target audio decoding capability of the audio peripheral. The display device directly selects the output configuration that matches the current audio data encoding format and specifications based on this target audio decoding capability, without considering any personalized requirements.

[0128] For example, if the target decoding capability of audio peripheral A connected to the TV is Dolby Digital Plus, and the TV has no user preference settings, then when playing audio data encoded in Dolby Digital, the TV can directly match this encoding format and output audio configuration adapted to Dolby Digital without any additional adjustments.

[0129] S433. If the target audio decoding capability supports the audio parameters corresponding to the user preference, and the display device has been configured with user preferences, then a second output configuration matching the audio data is determined based on the target audio decoding capability and the user preference.

[0130] When the display device has been configured with user preferences (such as enabling Dolby Atmos or prioritizing high-fidelity audio quality), and the target audio decoding capability of the audio peripheral can support the parameters corresponding to the user preferences, the matching process will take into account both the target audio decoding capability and user preferences to comprehensively determine the final output configuration, taking into account both hardware specifications and user personalized needs.

[0131] For example, if the user sets their preference to Dolby Atmos, and the target decoding capability of the connected audio peripheral also corresponds to Dolby Atmos, when playing audio data that supports this format, the TV will combine the Dolby Atmos decoding capability of the audio peripheral with the user's preference to output a configuration adapted to Dolby Atmos.

[0132] S434. If the target audio decoding capability does not support the audio parameters corresponding to the user preference when the display device has been configured with user preferences, then a third output configuration that matches the audio data shall be determined based on the support range of the target audio decoding capability itself.

[0133] When the display device has been configured with user preferences, but the target audio decoding capability of the audio peripheral cannot support the parameters corresponding to the user preferences (i.e., the audio decoding preference corresponding to the user preferences is higher than the target audio decoding capability), the matching process will abandon the user preferences and determine the appropriate output configuration based solely on the decoding specification range supported by the audio peripheral itself, prioritizing the compatibility and stability of audio decoding.

[0134] For example, a user sets their preference to Dolby Atmos, but the connected audio peripheral B's target decoding capability is Dolby Digital, which cannot resolve Dolby Atmos parameters. In this case, the TV can ignore the user's Dolby Atmos preference and only match and output the appropriate audio configuration according to the Dolby Digital supported by the audio peripheral.

[0135] During the above steps S432, S433 or S434, the display device will also adjust the channel configuration of the audio output according to the number of channels supported by the first audio peripheral and the metadata in the audio data (such as channel layout and spatial audio information), and adapt the spatial sound effects, sound positioning and other characteristics corresponding to the metadata to achieve audio output that matches the channel capabilities of the audio peripheral.

[0136] The audio processing method provided in this application embodiment displays that the device determines the output configuration of audio data through a preset strategy of hierarchical matching, follows the hardware decoding specifications of audio peripherals, and also takes into account the personalized needs of users, ultimately achieving an output configuration that is highly adapted to the audio data, ensuring the stability and sound quality of the audio output.

[0137] Based on the audio processing scheme introduced above, when the audio peripheral is an audio device that connects to the display device via an HDMI audio interface or Wi-Fi, the audio decoding capability corresponding to the audio peripheral determined by the controller includes one of the following: Dolby Metadata Enhanced Audio Transmission Decoding Capability, Dolby Atmos Decoding Capability, Dolby Digital Decoding Capability, or Pulse Code Modulation Decoding Capability. This will be further explained below.

[0138] Figure 6 Flowcharts of audio processing methods provided in some embodiments of this application are shown, such as... Figure 6 As shown, taking a television as an example, the television is configured to perform the following steps (1) to (5): (1) After the TV system starts, start the peripheral detection service.

[0139] (2) When the peripheral detection service detects a connection to an audio peripheral (HDMI connection / Wi-Fi connection), the capability detection engine obtains and parses the audio processing capability of the audio peripheral, as well as the stored decoding capability, number of channels and audio metadata parameters.

[0140] (3) Based on the audio processing capabilities, the TV determines whether the audio peripheral supports eARC: if the audio peripheral supports eARC, it determines that the audio peripheral has Dolby MAT decoding capability; if the audio peripheral does not support eARC, it enters the downgrade mode and iterates through the decoding capabilities of the audio peripheral to evaluate the decoding capability of the audio peripheral.

[0141] It should be noted that in some embodiments, in step (3), the decoding capabilities of the audio peripherals can be directly traversed by parsing, that is, based on the audio processing capabilities, the decoding capabilities of the audio peripherals can be traversed.

[0142] If the audio peripheral does not support eARC but supports Enhanced Audio Coding 3 (E-AC-3) and Joint Target Coding (JOC), then the audio peripheral is confirmed to have Dolby Atmos decoding capability.

[0143] If the audio peripheral only supports Enhanced Audio Codec 3 (E-AC-3), then the audio peripheral is confirmed to have Dolby Digital Plus decoding capability.

[0144] If the audio peripheral supports Audio Codec 3 (AC-3), then the audio peripheral is confirmed to have Dolby Digital decoding capability.

[0145] If the audio peripheral does not support AC-3, ensure that the audio peripheral has PCM decoding capability.

[0146] After step (3), the TV analyzes and determines the decoding capabilities supported by the audio peripherals, and notifies the various applications used for audio playback (such as the first application and the second application).

[0147] (4) The TV determines whether user preferences are set. If no user preferences are set, the data is directly transmitted; where, transmission (Atmos, lossless, multi-channel): means that the TV does not decode the audio, but directly sends the original compressed audio data to the audio peripherals (such as power amplifiers, soundbars) without modification or decoding.

[0148] (5) If user preference is set, and the user preference setting is lower than the amplifier's target audio decoding capability, then the audio data is output according to the setting; if the user preference setting is higher than the amplifier's target audio decoding capability, then the audio data is output according to the target audio decoding capability.

[0149] The audio processing method provided in this application embodiment automatically acquires and analyzes the audio processing capabilities of audio peripherals through the peripheral detection service after the TV system starts up. It evaluates the decoding specifications level by level in combination with eARC support, accurately determines the compatibility capabilities of Dolby MAT, Dolby Atmos, Dolby Digital Plus, etc., and synchronizes them to each audio application. At the same time, it executes audio output strategies based on the matching relationship between user preferences and audio peripheral decoding capabilities. This ensures the compatibility between audio output and audio peripheral hardware specifications, and also takes into account the user's personalized needs under the premise of compatibility, thereby achieving audio output stability and sound quality optimization.

[0150] Based on the audio processing scheme introduced above, when the audio peripheral device is an audio device that connects to the display device via Bluetooth or USB interface, the controller determines that the audio decoding capability corresponding to the audio peripheral device includes one of two-channel pulse code modulation decoding capability and multi-channel linear pulse code modulation decoding capability. This will be further explained below.

[0151] Figure 7 Flowcharts of audio processing methods provided in some embodiments of this application are shown, such as... Figure 7 As shown, the example of connecting a TV and an audio peripheral via Bluetooth is used for illustration. The TV is configured to perform the following steps (1) to (4): (1) After the TV system starts, start the peripheral detection service.

[0152] (2) When the peripheral detection service detects a connection with an audio peripheral (Bluetooth connection), the capability detection engine obtains and parses the audio processing capability of the audio peripheral, as well as the stored decoding capability, number of channels and audio metadata parameters.

[0153] (3) Based on its audio processing capabilities, the TV determines whether the audio peripheral supports multi-channel audio. If the audio peripheral supports multi-channel audio, it determines that the audio peripheral has LPCM decoding capability; if the audio peripheral does not support multi-channel audio, it determines that the audio peripheral has PCM decoding capability.

[0154] (4) Based on its audio processing capabilities, the TV analyzes whether the audio peripheral supports Bluetooth atmos virtualization. If the audio peripheral supports Bluetooth atmos virtualization, it is transcoded into LPCM data. If the audio peripheral does not support Bluetooth atmos virtualization, it outputs 2-channel PCM data.

[0155] LPCM data not only contains two-channel / multi-channel audio, but also embeds spatial metadata.

[0156] Among them, when the audio peripheral supports Bluetooth atmos virtualization, due to the bandwidth limitations of Bluetooth, the algorithm can simulate the three-dimensional spatial listening experience of Dolby Atmos while transmitting dual-channel PCM.

[0157] It should be noted that in some embodiments, user preferences may not be considered in the preset strategy.

[0158] The audio processing method provided in this application relies on the peripheral detection service after the TV is started. When an audio peripheral is connected via Bluetooth, the capability detection engine obtains and analyzes its audio processing capability. First, it determines the LPCM or PCM decoding capability based on the multi-channel support. Then, it performs differentiated transcoding and output strategies based on whether Bluetooth virtual surround sound is supported. If supported, it transcodes to LPCM containing spatial metadata and simulates Dolby Atmos listening through an algorithm. If not supported, it outputs dual-channel PCM data. The entire process matches the audio format based on the audio peripheral's decoding capability, ensuring the compatibility of audio output with the audio peripheral. This can optimize the spatial sound effect experience and sound quality output effect in Bluetooth or USB connection scenarios.

[0159] Based on the audio processing solution described above, this solution can be extended to multi-window display scenarios on display devices (such as the first window and the second window being tiled), where different windows carry different application content: the first window runs the first application and plays the first audio data, and the second window runs the second application and plays the second audio data.

[0160] To provide independent and high-quality audio experiences for user A viewing the first window and user B viewing the second window, the display device will independently match and process the audio data for each window: when the first audio data is output through the first audio peripheral, it will be matched with the first parameter and a preset strategy to generate an appropriate output configuration; similarly, when the second audio data is output through the second audio peripheral, it will be matched with the second parameter and a preset strategy to generate an appropriate output configuration. Further explanation follows.

[0161] Figure 8 The following are schematic diagrams illustrating application scenarios of the audio processing methods provided in some embodiments of this application, such as... Figure 8 As shown, taking a TV as an example, the TV displays a first window and a second window in a tiled manner. The first window runs a first application and plays the first audio data, while the second window runs a second application and plays the second audio data.

[0162] When an audio communication connection is established between the TV and the first audio peripheral, the TV obtains the audio processing capabilities of the first audio peripheral; analyzes the audio processing capabilities of the first audio peripheral to obtain the first parameters supported by the first audio peripheral; and writes the first parameters supported by the first audio peripheral into the capability configuration file.

[0163] When the TV establishes an audio communication connection with the first audio peripheral, the TV obtains the audio processing capabilities of the second audio peripheral; it parses the audio processing capabilities of the second audio peripheral to obtain the second parameters supported by the second audio peripheral (which also include decoding capabilities, number of channels, and audio metadata); and writes the second parameters supported by the second audio peripheral into the capability configuration file.

[0164] When the first audio data is output through a Bluetooth headset (first audio peripheral) and the second audio data is output through a soundbar (second audio peripheral), the first audio data is matched with the parameters (decoding capability, number of channels, and audio metadata) of the Bluetooth headset based on a preset strategy to obtain the output configuration matching the first audio data; and the second audio data is matched with the parameters (decoding capability, number of channels, and audio metadata) of the soundbar based on a preset strategy to obtain the output configuration matching the second audio data.

[0165] In the above process, the first application obtains a list of audio codecs supported by the Bluetooth headset, determines the highest level of audio decoding specifications it can support, and then filters and matches the encoding format corresponding to the audio data based on this decoding capability. The second application obtains a list of audio codecs supported by the soundbar, determines the highest level of audio decoding specifications it can support, and then filters and matches the encoding format corresponding to the audio data based on this decoding capability. This effectively ensures that the audio output configuration is compatible with the decoding specifications of the audio peripheral, improving the audio output quality.

[0166] Furthermore, the first audio data of the TV control first application is output through Bluetooth headphones, and the second audio data of the second application is output through a soundbar.

[0167] The audio processing solution provided in this application extends to multi-window TV scenarios. For independent audio peripherals (Bluetooth headphones, soundbars) corresponding to different windows, the solution acquires and parses the audio processing capabilities of the peripherals, writes them into configuration files, and matches and adapts the output configuration for different audio data based on a preset strategy. At the same time, it selects and matches the audio encoding format based on the highest decoding specifications of each peripheral, thereby enabling independent listening experiences for different users in multi-window scenarios, ensuring the adaptation of audio output to the decoding capabilities of audio peripherals, and improving the audio output quality and user experience in multiple scenarios.

[0168] Based on the audio processing solution described above, Figure 9 Timing diagrams of audio processing methods provided in some embodiments of this application are shown, such as... Figure 9 As shown, in this embodiment, the audio policy service is integrated within the application, and the display device is configured to perform the following steps (1) to (4): (1) Display device automatically starts peripheral monitoring service when powered on. When peripheral monitoring service detects a new audio peripheral connection, it actively obtains the device type and connection status of the audio peripheral.

[0169] (2) After receiving the device type and connection status sent by the peripheral monitoring service, the capability detection engine in the display device actively sends a capability query to the audio peripheral based on the protocol when it is connected, and receives the information of the label protocol (i.e., the information of audio processing capability) returned by the audio peripheral.

[0170] (3) The capability detection engine analyzes the audio processing capabilities of the audio peripheral based on the protocol and obtains the parameters in the audio processing capabilities (decoding capability, number of channels and audio metadata).

[0171] (4) The capability detection engine sends the decoding capability, number of channels and audio metadata to the dynamic decision engine.

[0172] (5) The dynamic decision engine in the display device writes the decoding capability, number of channels and audio metadata into the built capability configuration file and writes the capability configuration file into the system-level ContentProvider.

[0173] (6) The ContentProvider in the display device sends a capability update broadcast to the audio application, notifying the audio application that the audio processing capability of the audio peripheral has changed.

[0174] (7) The application audio policy service in the display device matches its audio data with the parameters of the corresponding audio peripheral in the capability configuration file based on preset policies (compatibility, user preference, fidelity) to obtain the audio data output configuration (audio format, channel configuration, whether to pass through, etc.).

[0175] Among these considerations, compatibility is prioritized: ensure that the selected format is supported by the audio peripherals to avoid silence. If user preferences are set, prioritize them. Select the highest quality lossless format supported by all peripherals to improve fidelity.

[0176] (8) The display device sends audio data to the audio peripheral in the output configuration.

[0177] For details on the above implementation process, please refer to the detailed description of steps S410 to S440 above, which will not be repeated here.

[0178] It should be understood that the sequence numbers of the processes in the above embodiments do not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The various embodiments described herein can be independent solutions or combinations based on internal logic, and all such solutions fall within the protection scope of this application.

[0179] It should also be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0180] Based on the same concept, as an implementation of the above method, this application provides an audio processing device. This device embodiment corresponds to the aforementioned method embodiment. For ease of reading, this device embodiment will not repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in this embodiment can implement all the contents of the aforementioned method embodiment.

[0181] Figure 10 A schematic diagram of an audio processing apparatus provided in some embodiments of this application is shown. The audio processing apparatus 1000 includes a capability acquisition unit 1010, a capability analysis unit 1020, a matching unit 1030, and an audio output unit 1040. The functions of each module are detailed below.

[0182] The capability acquisition unit 1010 is used to acquire the audio processing capabilities of the first audio peripheral when establishing an audio communication connection with it. The audio processing capabilities of the first audio peripheral are used to indicate relevant parameters that the first audio peripheral supports for audio playback.

[0183] The capability analysis unit 1020 is used to analyze the audio processing capabilities of the first audio peripheral and obtain the first parameters supported by the first audio peripheral. The first parameters include decoding capability, number of channels and audio metadata.

[0184] The matching unit 1030 is used to match the audio data with the first parameter based on a preset strategy when the audio data of the first application is output through the first audio peripheral, so as to obtain the output configuration of the audio data matching.

[0185] The audio output unit 1040 is used to process audio data based on the output configuration and send the processed data to the first audio output.

[0186] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the focusing methods provided in the above embodiments.

[0187] This application also provides a chip, which includes a processor and a memory. The memory stores a computer program, which, when executed by the processor, implements the focusing methods provided in the above embodiments.

[0188] This application also provides a computer program product, which includes a computer program that, when executed by an execution device, causes the execution device to implement the focusing method provided in the above embodiments.

[0189] It should be understood that the processor mentioned in the embodiments of this application may be a central processing unit (CPU), a graphics processing unit (GPU), an image signal processor (ISP), and / or a neural network processing unit (NPU), or other general-purpose processors. A general-purpose processor may be a microprocessor or any conventional processor.

[0190] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0191] In the embodiments provided in this application, the division of various frameworks, modules, or units is merely a logical functional division. In actual implementation, there may be other division methods. For example, multiple frameworks, modules, or units may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the functional modules in the various embodiments of this application may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0192] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0193] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0194] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A display device, characterized in that, include: monitor; The peripheral interface is configured to communicate with one or more audio peripherals and output audio. The controller is configured as follows: When establishing an audio communication connection with the first audio peripheral, the audio processing capability of the first audio peripheral is obtained; the audio processing capability of the first audio peripheral is used to indicate the relevant parameters that the first audio peripheral supports for audio playback. The audio processing capabilities of the first audio peripheral are analyzed to obtain the first parameters supported by the first audio peripheral. The first parameters include decoding capabilities, number of channels, and audio metadata. When the first audio data of the first application is output through the first audio peripheral, the first audio data and the first parameter are matched based on a preset strategy to obtain the output configuration matching the first audio data. The first audio data is processed based on the output configuration, and the processed data is sent to the first audio output.

2. The display device according to claim 1, characterized in that, The controller performs a matching operation between the first audio data and the first parameter based on a preset strategy to obtain an output configuration that matches the first audio data. The controller is also configured to: Based on the first parameter, the target audio decoding capability corresponding to the first audio peripheral is determined, and the target audio decoding capability is used to indicate the highest level of audio decoding specification that the first audio peripheral can support. In the absence of user preferences configured on the display device, a first output configuration matching the first audio data is determined based on the target audio decoding capability.

3. The display device according to claim 2, characterized in that, The controller is also configured to: If the display device has been configured with user preferences: If the target audio decoding capability supports the audio parameters corresponding to the user preference, then a second output configuration matching the first audio data is determined based on the target audio decoding capability and the user preference. If the target audio decoding capability does not support the audio parameters corresponding to the user preference, then a third output configuration matching the first audio data is determined based on the support range of the target audio decoding capability itself.

4. The display device according to any one of claims 1 to 3, characterized in that, When the first audio peripheral is an audio device that establishes a connection with the display device via an HDMI audio interface or Wi-Fi, the audio decoding capability corresponding to the first audio peripheral determined by the controller includes one of Dolby Metadata Enhanced Audio Transmission Decoding Capability, Dolby Atmos Decoding Capability, Dolby Digital Decoding Capability, or Pulse Code Modulation Decoding Capability.

5. The display device according to any one of claims 1 to 3, characterized in that, When the first audio peripheral device is an audio device that establishes a connection with the display device via Bluetooth or USB interface, the controller determines that the audio decoding capability corresponding to the first audio peripheral device includes one of two-channel pulse code modulation decoding capability and multi-channel linear pulse code modulation decoding capability.

6. The display device according to claim 2, characterized in that, The preset strategy includes the compatibility between the first audio data and the first audio peripheral; the matching degree between the user preference and the audio decoding capability; and the fidelity of the first audio data.

7. The display device according to claim 1, characterized in that, After the controller performs analysis of the audio processing capabilities of the first audio peripheral and obtains the first parameters supported by the first audio peripheral, it is further configured to: Write the first parameter supported by the first audio peripheral into a preset configuration file to obtain the capability configuration file; The capability configuration file is stored in a system-level data sharing component; the data in the system-level data sharing component can be accessed by the first application.

8. The display device according to claim 1, characterized in that, The controller is also configured to: When establishing an audio communication connection with the second audio peripheral, the audio processing capabilities of the second audio peripheral are obtained, and the second parameters supported by the second audio peripheral are determined. The second parameters include decoding capabilities, number of channels, and audio metadata. Write the second parameter supported by the second audio peripheral into the capability configuration file; When the controller executes the operation of matching the first audio data with the first parameter based on a preset strategy to obtain the output configuration matching the first audio data when the first audio data of the first application is output through the first audio peripheral, it is further configured as follows: When the second audio data of the second application is output through the second audio peripheral, the second audio data is matched with the second parameter based on a preset strategy to obtain the output configuration matching the second audio data.

9. The display device according to claim 1, characterized in that, The peripheral interface includes a communicator and an audio output interface; The communicator includes at least one of a Wi-Fi module, a Bluetooth module, and an Ethernet module; The audio output interface includes at least one of the following: analog audio interface, USB audio interface, HDMI audio interface, and optical fiber interface.

10. An audio processing method, characterized in that, Applied to a display device as described in claims 1-9, the display device including a first application for playing first audio data, the method comprising: When establishing an audio communication connection with the first audio peripheral, the audio processing capability of the first audio peripheral is obtained; the audio processing capability of the first audio peripheral is used to indicate the relevant parameters that the first audio peripheral supports for audio playback. The audio processing capabilities of the first audio peripheral are analyzed to obtain the first parameters supported by the first audio peripheral. The first parameters include decoding capabilities, number of channels, and audio metadata. When the first audio data of the first application is output through the first audio peripheral, the first audio data and the first parameter are matched based on a preset strategy to obtain the output configuration matching the first audio data. The first audio data is processed based on the output configuration, and the processed data is sent to the first audio output.

Images