A display device, an external device, and an audio output method.

Abstract

This application provides a display device, an external device, and an audio output method. The method, after a user inputs a control command to play audio data, detects the speaker information of the display device and the external device to determine the available number and location of the local and external speakers. Then, based on the available number and location of the speakers, it sets the audio data output path to play the audio data through both the local and external speakers. This method allows audio data to be output simultaneously through both the local and external speakers, creating a blended effect according to a playback mode adapted to the speaker locations. It increases the number of audio output channels or enhances the output effect of some channels, meeting the user's needs for audio output quality.

Description

Technical Field

[0001] This application relates to the field of intelligent display device technology, and in particular to a display device, an external device, and an audio output method. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, mobile terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] Smart TVs also have external device interfaces, allowing them to connect to external devices that can output audio or video, thus enabling the TV to output the sound or picture it is playing. For example, to improve the sound quality of a smart TV, a soundbar can be connected. When the smart TV is playing audio data or video data with sound, it can send the decoded audio signal to the soundbar for output.

[0004] Because smart TVs' audio links do not support simultaneous signal output from the audio output interface and the built-in speaker system, the built-in speakers of a smart TV and external audio devices are mutually exclusive and cannot produce sound simultaneously. This means that when an external audio device is connected to a smart TV, the built-in speakers remain unused, and the smart TV's audio output quality depends solely on the hardware configuration of the external audio device, failing to meet the high-quality audio output needs of some users. Summary of the Invention

[0005] This application provides a display device, an external device, and an audio output method to solve the problem of poor audio output effect in traditional display devices.

[0006] In a first aspect, this application provides a display device, including: a display, a built-in speaker, an external device interface, and a controller. The display is configured to display a user interface; the built-in speaker is configured to play audio data; the external device interface is configured to connect to an external device, the external device including at least one external speaker; and the controller is configured to execute the following program steps:

[0007] Obtain user-input control commands for playing audio data;

[0008] In response to the control command, speaker parameters are detected, including the available number and installation location of the local speaker and the available number and setting location of the external speaker;

[0009] The audio data output path is set according to the speaker parameters to play the audio data through the local speaker and the external speaker.

[0010] Based on the aforementioned display device, this application also provides an audio output method, applied to the aforementioned display device, the audio output method comprising the following steps:

[0011] Obtain user-input control commands for playing audio data;

[0012] In response to the control command, speaker parameters are detected, including the available number and installation location of the local speaker and the available number and setting location of the external speaker;

[0013] The audio data output path is set according to the speaker parameters to play the audio data through the local speaker and the external speaker.

[0014] Secondly, this application also provides an external device, including: an external speaker, an audio interface, and a processor. The external speaker is configured to output audio data; the audio interface is configured to connect to a display device to acquire the audio data from the display device; and the processor is configured to execute the following program steps:

[0015] In response to the detection action of the display device, the available number and setting position of the external speakers are sent to the display device to generate speaker parameters; the speaker parameters include the available number and installation position of the display device's own speakers and the available number and setting position of the external speakers;

[0016] The display device receives audio data according to the output path set by the speaker parameters.

[0017] Play the audio data.

[0018] Based on the aforementioned external device, a second aspect of this application also provides an audio output method applied to the aforementioned external device, the audio output method comprising the following steps:

[0019] In response to the detection action of the display device, the available number and setting position of the external speakers are sent to the display device to generate speaker parameters; the speaker parameters include the available number and installation position of the display device's own speakers and the available number and setting position of the external speakers;

[0020] The display device receives audio data according to the output path set by the speaker parameters.

[0021] Play the audio data.

[0022] As can be seen from the above technical solutions, the display device, external device, and audio output method provided in this application can detect the speaker information of the display device and external device after the user inputs a control command to play audio data, in order to determine the available number and location of the local and external speakers. Then, based on the available number and location of the speakers, the audio data output path is set so that the audio data can be played through the local and external speakers. This method allows audio data to be output simultaneously through both the local and external speakers, forming a blending effect according to a playback mode adapted to the speaker locations, increasing the number of audio output channels or enhancing the output effect of some output channels, thereby meeting the user's needs for audio output effects. Attached Figure Description

[0023] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This application illustrates the usage scenario of the display device.

[0025] Figure 2 This is a hardware configuration block diagram of the control device in the embodiments of this application;

[0026] Figure 3 This is a hardware configuration diagram of the display device in the embodiments of this application;

[0027] Figure 4 This is a software configuration diagram of the display device in the embodiments of this application;

[0028] Figure 5 This is a schematic diagram of the external device connection in the embodiments of this application;

[0029] Figure 6 This is a schematic diagram of the interactive menu interface in the embodiments of this application;

[0030] Figure 7 This is a schematic diagram of the audio output method on the display device side in the embodiments of this application;

[0031] Figure 8 This is a schematic diagram showing the timing relationship of the audio output method on the display device side in the embodiments of this application;

[0032] Figure 9 This is a flowchart illustrating the process of setting audio configuration strategy information in an embodiment of this application;

[0033] Figure 10 This is a schematic diagram of the fusion result in an embodiment of this application;

[0034] Figure 11a This is a schematic diagram illustrating the process of setting up an output path that does not include a center speaker in the embodiments of this application;

[0035] Figure 11b This is a schematic diagram illustrating the process of setting the output path for a center speaker in an embodiment of this application.

[0036] Figure 12 This is a schematic diagram of the audio output circuit in an embodiment of this application;

[0037] Figure 13 This is a schematic diagram of the audio output method for external devices in an embodiment of this application;

[0038] Figure 14 This is a schematic diagram of the timing relationship of the audio output method on the external device side in the embodiments of this application. Detailed Implementation

[0039] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0040] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0041] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0042] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0043] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0044] Figure 1 This is a schematic diagram illustrating a usage scenario of the display device according to an embodiment. For example... Figure 1 As shown, the display device 200 also communicates with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100.

[0045] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting user commands through at least one method, such as buttons on the remote control, voice input, or control panel input.

[0046] In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet computer, computer, laptop computer, AR / VR device, etc.

[0047] In some embodiments, a smart device 300 may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0048] In some embodiments, the smart device 300 and the display device may also be used for data communication.

[0049] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0050] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0051] In some embodiments, software steps executed by one execution entity can be migrated to another execution entity with which it communicates data, as needed. For example, software steps executed by a server can be migrated to a display device with which it communicates data, and vice versa.

[0052] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0053] In some embodiments, the communication interface 130 is used for external communication and includes at least one of a WIFI chip, a Bluetooth module, an NFC module, or an alternative module.

[0054] In some embodiments, the user input / output interface 140 includes at least one of a microphone, touchpad, sensor, button, or alternative module.

[0055] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0056] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0057] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0058] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0059] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0060] In some embodiments, the tuner 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0061] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0062] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0063] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0064] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0065] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0066] In some embodiments, the object can be any of the optional objects, such as a hyperlink, an icon, or other operable controls. Operations related to the selected object include: displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon.

[0067] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0068] A CPU (CPU) processor is used to execute operating system and application instructions stored in memory, as well as various interactive instructions received from external input, to execute various applications, data, and content, ultimately for the display and playback of various audio and video content. A CPU processor can include multiple processors, such as a main processor and one or more sub-processors.

[0069] In some embodiments, a graphics processor is used to generate at least one of various graphical objects, such as icons, operation menus, and user-input-based graphics. The graphics processor includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes; it also includes a renderer that renders the various objects obtained from the ALU, the rendered objects being displayed on a monitor.

[0070] In some embodiments, a video processor is configured to receive an external video signal and perform at least one of the following video processing operations according to a standard encoding and decoding protocol of the input signal: decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., to obtain a signal that can be directly displayed or played on a display device 200.

[0071] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, and a display formatting module. The demultiplexing module demultiplexes the input audio and video data streams. The video decoding module processes the demultiplexed video signal, including decoding and scaling. The image compositing module, such as an image synthesizer, overlays and blends a GUI signal generated by a graphics generator based on user input or its own generation with the scaled video image to generate a displayable image signal. The frame rate conversion module converts the input video frame rate. The display formatting module modifies the received frame rate-converted video output signal to conform to a display format, such as outputting RGB data signals.

[0072] In some embodiments, an audio processor is configured to receive external audio signals, perform decompression and decoding according to a standard codec protocol of the input signal, and at least one of the following processes: noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in a speaker.

[0073] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0074] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0075] In some embodiments, the user interface 280 is an interface that can be used to receive control input (e.g., physical buttons on the display device body, or others).

[0076] In some embodiments, the display device's system may include a kernel, a command interpreter (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. Upon power-up, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, the scheduler, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. Applications are compiled into machine code after startup, forming a process.

[0077] See Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0078] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0079] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0080] like Figure 4 As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0081] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0082] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0083] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0084] like Figure 5 As shown, based on the aforementioned display device 200, a user can connect an external device 500 via the external device interface 240. The external device 500 can have output functionality, capable of outputting sound and video. For example, the external device 500 can be a soundbar with audio output capabilities. The external device 500 can connect to the external device interface 240 via specific interface specifications, such as HDMI or USB. For example, the soundbar can connect to the display device 200 via a USB interface. When the display device 200 needs to output audio, it can send audio data to the soundbar via the USB interface, and the soundbar then converts the audio data into a sound signal to achieve audio output.

[0085] In some embodiments, the external device 500, in addition to its output function, may also have certain data processing functions for controlling the audio and video output process. For example, for a soundbar, it may also perform audio quality processing on the audio transmitted from the display device 200 to play the audio data according to a specific output method and obtain the corresponding sound quality effect. Therefore, users can control the data processing function through interactive actions, that is, set the output method. For example, the settings supported by the soundbar include sound effect mode, surround switch, treble adjustment, bass adjustment, display brightness adjustment, and factory reset.

[0086] The external device 500 can have built-in setup interaction methods, such as buttons, knobs, and switches on the soundbar. Users can adjust these interactive components by pressing or rotating them to complete the setup process. In some embodiments, the external device 500 can also support remote control setup; that is, the external device 500 can be equipped with a remote control. The remote control has function buttons and connects to the external device 500 wirelessly via infrared, Bluetooth, or other transmission methods. During setup, the user can input the interactive action corresponding to the function to be set using the buttons on the remote control, causing the remote control to send a wireless signal to the external device 500. After receiving the wireless signal, the external device 500 can complete the corresponding settings based on the interactive action.

[0087] The external device 500 can also complete the setting function through the display device 200 after being connected to the display device 200. That is, the user can input interactive actions based on the interaction method of the display device 200. The display device 200 then generates setting instructions based on the interactive actions and sends the setting instructions to the external device 500, so that the external device 500 can implement the corresponding settings according to the setting instructions after receiving them.

[0088] In order to control the external device 500 via the display device 200, the display device 200 needs to establish a communication connection with the external device 500. The specific communication connection method can be based on the external device interface 240. For example, a soundbar can be connected to the display device 200 via an HDMI interface. When the display device 200 needs to output sound, it can transmit audio data to the soundbar via the time minimized differential signal (TMDS) pin of the HDMI interface. Furthermore, when the display device 200 needs to send setting commands to the soundbar, it can transmit the setting commands to the soundbar via the consumer electronic control (CEC) pin of the HDMI interface.

[0089] The display device 200 can also establish a communication connection with an external device 500 based on the communicator 220 to transmit various commands and / or audio and video data. The communicator 220 can implement wired or wireless connection methods based on different communication protocols. For example, the communicator 220 of the display device 200 can have a built-in Bluetooth module, and the soundbar also has a Bluetooth module, so the display device 200 can establish a communication connection with the soundbar via Bluetooth.

[0090] Therefore, when the display device 200 needs to send a setting command to the soundbar, the setting command can be sent to the external device 500 via the communicator 220. For example, Figure 6 As shown, when volume adjustment is needed, the user can access the interactive menu interface related to the external speaker through the control device 100, select the volume option in the interactive menu, and input the setting command to increase or decrease the volume. The display device 200 then sends the setting command to the soundbar via the Bluetooth module in the communicator 220. Upon receiving the setting command, the soundbar can increase the gain of the audio output path according to the setting command to increase or decrease the output volume.

[0091] Different types of external devices 500 support different communication methods. Some external devices 500 support multiple communication methods, while others support only one. For example, some higher-end soundbars support analog, optical, or coaxial cable interfaces for transmitting audio data, and also support Bluetooth, HDMI audio return channel (ARC), and HDMI input (IN) interfaces for transmitting audio-related commands. Lower-end soundbars, on the other hand, only support analog signal interfaces for transmitting audio data and Bluetooth communication for transmitting commands.

[0092] For different types of external devices, 500 can also achieve audio / video output and control functions through different data / command transmission methods. For example, for lower-end soundbars, an analog signal cable can be connected to the external device interface 240 of the display device 200 to obtain audio data from the display device 200 via analog signals. Simultaneously, the soundbar can also establish a communication connection with the display device 200 via Bluetooth. During use, the display device 200 can send audio data to the soundbar through the external device interface 240. Furthermore, when it is necessary to control and adjust the soundbar's volume, sound quality, and other operating parameters, setting commands can be sent to the soundbar through the Bluetooth module of the communicator 220.

[0093] In some embodiments, audio data and setting instructions can be obtained directly from the display device 200 via the HDMI interface simultaneously, without the need for an additional Bluetooth module. Furthermore, for external devices 500 that support wireless playback, such as Bluetooth speakers, audio data and setting instructions can also be transmitted simultaneously via Bluetooth connection, allowing audio output through the Bluetooth speaker while settings are executed on the external device 500 via the display device 200.

[0094] To accommodate various types of external devices 500, in some embodiments of this application, the display device 200 connects to the external device 500 via an external device interface 240 to transmit audio and video data; simultaneously, it also establishes a communication connection with the external device 500 via a communicator 220 to transmit setting commands. This data / command transmission method not only accommodates various types of external devices 500 but also leverages the transmission efficiency of the external device interface 240 to reduce latency and stuttering during audio and video output.

[0095] After the display device 200 is connected to an external device 500, the original audio-video data output mode will be changed. For example, when the display device 200 is connected to a sound device, the audio signal generated by the display device 200 when playing media data will be output by the external sound device, and the built-in speaker of the display device 200 will stop working. Such an audio output mode can enable the display device 200 to obtain the audio output effect of the external sound device and improve the audio output quality.

[0096] However, with the continuous upgrading of the hardware facilities of the display device 200, the built-in speaker of the display device 200 also has a good sound quality effect. Therefore, in order to meet the user's demand for better sound quality effect, in some embodiments, the display device 200 can provide a sound quality fusion mode, that is, after the display device 200 enables the sound quality fusion mode, it can output audio through both the built-in speaker of the display device 200 and the external speaker of the external device 500, and through reasonable switching and path planning, obtain a better audio output effect.

[0097] In order to implement the above audio output mode, in some embodiments of the present application, an audio output method applied to the display device 200 is provided. To meet the implementation requirements of the audio output method, the display device 200 should at least include a display 260, a built-in speaker 271, an external device interface 240, and a controller 250. Among them, the display 260 is used to display the user interface. The built-in speaker is used to play audio data. The external device interface 240 is used to connect to the external device 500, and the connected external device 500 includes at least one external speaker. The controller 250 can be configured to execute the application program corresponding to the audio output method to play media data according to the audio output method, as Figure 7 、 Figure 8 shown, and specifically includes the following content:

[0098] Obtain a control instruction for playing audio data input by the user. According to the UI interaction method defined in the operating system of the display device 200, the user can control the display device 200 to play audio data through specific interaction actions. For example, the user can use the direction keys on the control device 100 supporting the display device 200 to control the movement of the focus cursor in the user interface. When the focus cursor moves to a specific media item, the user then presses the confirmation key on the control device 100 to control the display device 200 to play the selected media item. During this period, if the media item selected by the user can output sound, when the display device 200 plays the media item, it will play the audio data together, that is, the display device 200 obtains a control instruction for playing audio data.

[0099] Obviously, the user interface that allows users to select media asset items can include, but is not limited to, a media asset list interface, a media asset recommendation interface, a special channel interface, and a resource manager interface. The media asset item selected by the user through the focus cursor in the user interface can be a pure audio media asset item or a video media asset item. When the selected media asset item is video, the display device 200 will decode the media asset data during playback to obtain video data used to form the displayed content and audio data used to form the sound content. The video data can be output through the monitor 260, while the audio data can be output through the built-in speakers and external speakers.

[0100] In addition to inputting control commands for playing audio data by selecting any media asset as described above, the display device 200 can also determine whether audio data needs to be output based on the user's usage scenario. For example, when the display device 200 is running applications such as voice assistants, the running applications can automatically trigger the display device 200 to play audio data when functions such as environment simulation, atmosphere rendering, and prompts are required. That is, the display device 200 can obtain control commands for playing audio data through the application's running status.

[0101] After receiving a control command for playing audio data, the display device 200 can respond to the control command by detecting the speaker parameters of both the display device 200 itself and the external device 500. These speaker parameters include the available number and installation location of the local speakers, as well as the available number and location of the external speakers.

[0102] Speaker parameters can be obtained by reading the device's identification information and matching it with a pre-stored data lookup table. The device identification information refers to a string that represents both the display device 200 and the external device 500. For example, the display device 200 can obtain its own identification information as "H××100L9 Pro". After the external device 500 is connected to the external device interface 240 of the display device 200, the display device 200 can read the external device 500's identification information as "S××SP2-11".

[0103] After reading the identification information, the display device 200 can determine the available number of speakers in the display device 200 and the external device 500 using a pre-stored device lookup table. That is, according to the channel description, the display device 200 with the identification information "H××100L9 Pro" includes a ceiling speaker, front speakers, and a subwoofer. The front speakers may include a left channel speaker and a right channel speaker, so the display device 200 has 4 available speakers. Similarly, by matching the identification information of the external device 500 in the device lookup table, the available number of speakers in the external device 500 can be obtained. For example, if the matching determines that the external device 500 with the identification information "S××SP2-11" includes 6 speakers, then the available number is 6.

[0104] It should be noted that the device lookup table used to match the number of available speakers can be built into the display device 200, and its entries can be updated automatically or manually as the user connects external devices 500 to the display device 200. Alternatively, the device lookup table can be stored in the server 400 connected to the display device 200 and updated and maintained by the server 400. Therefore, when the display device 200 needs to detect speaker information, it can send a query request to the server 400, triggering the server 400 to query the device lookup table for the number of available speakers on the external device 500, and then return the query result to the display device 200 to generate speaker information.

[0105] Speaker parameters can also be obtained by reading the hardware interface information of the display device 200, both internal and external. That is, the display device 200 can determine the number of paths used for audio output by reading the hardware device connection information on the motherboard interface; typically, each path corresponds to one speaker.

[0106] For external devices 500 whose hardware connection status cannot be directly read by display device 200, display device 200 can also send a detection request to external device 500 when detecting speaker information. After receiving the detection request, external device 500 will then report back to display device 200 the number of currently available speakers.

[0107] After detecting the number of available speakers, the display device 200 can also detect the location of the speakers. Since the speakers are built into the display device 200, the internal layout of the display device 200 can be determined simultaneously with the detection of the number of available speakers, thus determining the installation location of the speakers.

[0108] As for external speakers, their placement depends on the user's actions, so it can be manually input by the user. That is, when the user enables the audio fusion mode of the display device 200, the user can manually input the setting position information through a specific settings interface, including the distance between the speakers and the display device 200, the distance between the two speakers, etc.

[0109] In some embodiments, the display device 200 can also automatically detect the location of the external device 500 through image recognition, wireless signal detection, or other methods. For example, for a display device 200 with a built-in or external camera, the display device 200 can capture images of the current environment through the camera, perform image analysis processing on the captured images, identify the audio equipment in the images, and determine the distance between the audio equipment and the display device 200. As another example, for an external device 500 that supports infrared, Bluetooth, wireless radio frequency, or other transmission methods, the display device 200 can send a detection signal to the external device 500 through a wireless connection module and measure the transmission time of the detection signal, thereby using electromagnetic wave ranging to detect the distance between the display device 200 and the external device 500.

[0110] After obtaining the speaker parameters, the display device 200 can set the audio data output path according to the speaker parameters to play audio data through the local speaker and external speakers. During the output path setting process, the display device 200 can determine the number of audio output channels based on the number of available speakers. Furthermore, the specific channel mode can be determined by the speaker positions.

[0111] For example, when the display device 200 has two available speakers, placed on the left and right sides of the display device 200, and the external device 500 also has two available speakers, placed to the left and right rear of the user in the current playback environment, the two speakers of the display device 200 can be determined as the output paths for playing the left and right channels, while the two speakers of the external device 500 can be determined as the output paths for the left and right surround channels.

[0112] As can be seen, in the above embodiments, the audio output method can, when the display device 200 plays audio data, detect speaker parameters to set the audio output path according to the speaker parameters, thereby achieving simultaneous audio output through both the local speaker and external speakers. By using the available number of speakers and their positions in the speaker data, the display device 200 can obtain a richer number of audio output channels than both the local and external devices 500, and output the audio from the corresponding channels, thus achieving a supplementary effect to the high-quality audio output mode and improving the audio output quality.

[0113] like Figure 9As shown, in some embodiments, after the display device 200 sets the audio data output path according to the speaker parameters, the display device 200 can control the external device 500 to output audio in the set manner according to the set output path. That is, the controller 250 can first obtain the identification information of the display device 200 and associate the identification information with the set output path to record the output path.

[0114] For example, the display device 200 can record various audio parameters in the setting results, and the recorded data structure is as follows:

[0115]

[0116] The recorded audio parameters can be applied to subsequent audio fusion. That is, display device 200 can use the parameters from both its own system and external device 500 to calculate a reasonable acoustic architecture. The fusion result is then recorded using the following data structure:

[0117] CombinedSystem1 = (ID1, ID2, Result) is used to record the fusion results of two systems that have been merged. If different systems have been merged, multiple data entries will be recorded.

[0118] As can be seen, by recording and saving the output path settings, when the current external device 500 reconnects to the display device 200, audio output can be directly performed based on the recorded output path settings, avoiding repeated settings.

[0119] After recording the output path, the display device 200 can also generate audio configuration strategy information based on the output path and the identification information of the display device 200, and send the audio configuration strategy information to the external device 500 so that the external device 500 can play audio data according to the output path.

[0120] In some embodiments, in order to set the output path of audio data according to speaker parameters, the display device 200 can calculate the total number of its own speakers and external speakers after detecting the speaker parameters, and perform decoding on the audio data according to the total number to obtain multi-channel data. The number of channels in the multi-channel data is equal to the total number. For example, if the speaker data of the display device 200 is detected as having a left channel speaker, a center speaker, and a right channel speaker, the usable number is 3; and the speakers of the external device 500 are a left channel speaker and a right channel speaker, the usable number is 2. Therefore, the total number of the own speakers and external speakers can be calculated to be 5. That is, the audio system composed of the merged display device 200 and external device 500 can support a maximum of 5 channels of audio output.

[0121] After acquiring the multi-channel data, the display device 200 then transmits the multi-channel data to each of its own speakers or external speakers according to the speaker positions. For example, based on the detected positions of the five speakers, the display device 200 can configure three of its own speakers to maintain their original output format, meaning the left, center, and right channel speakers of the display device 200 will output left-channel audio, center-channel audio, and right-channel audio, respectively. Since the two speakers of the external device 500 are located at the left and right rear of the user's viewing area, the output paths of the two speakers of the external device 500 can be changed so that they no longer output left-channel and right-channel audio, but instead output left surround channel audio and right surround channel audio.

[0122] Depending on the audio output mode, a more harmonious audio output effect can usually be achieved with a specific number of channels. For example, to present a 5.1 surround sound effect, the device capable of playing audio can provide a left channel, center channel, right channel, left surround channel, and right surround channel. Therefore, after the display device 200 and the external device 500 are merged, the number of speakers capable of presenting the final audio output effect is not a simple summation of speaker numbers, but rather requires a specific number of speaker combinations according to a specific merging method. That is, in some embodiments, the display device 200 can obtain the audio output modes of the display device 200 and the external device 500 when calculating the total number of its own speakers and external speakers, and then query the merging result from a preset merging data table based on the audio output mode. By querying the merging data table, the display device 200 can obtain a new output mode in the merging result that is different from the original output mode of the display device 200 and the output mode of the external device 500.

[0123] For example, the content of the merged data table is as follows:

[0124]

[0125] When the current audio output mode of display device 200 is 2.1, and the current audio output mode of external device 500 is 3.1, the new output mode in the fusion result will be 5.1, which means it can provide left channel, center channel, right channel, left surround channel, right surround channel, and subwoofer channel, such as... Figure 10 As shown.

[0126] After obtaining a new output mode based on the fusion result, the display device 200 can then obtain the total number of speakers by iterating through the number of speakers required for the new output mode. For example, if the new output mode in the fusion result is 5.1, it requires 6 speakers: a left channel speaker, a center channel speaker, a right channel speaker, a left surround channel speaker, a right surround channel speaker, and a subwoofer channel speaker. That is, the total number of speakers determined by querying the fusion result is 6.

[0127] As can be seen, the total number of speakers obtained through the above method can adapt to the requirements of specific audio output modes, avoiding mode mismatch issues and making the merged audio output effect more harmonious, thus improving the user experience.

[0128] In some embodiments, in order to set the audio output effect of the merged display device 200 and external device 500, when the display device 200 sets the output path of the audio data according to the speaker parameters, it can first obtain the distance judgment value between the display device 200 and the external device 500, wherein the distance judgment value is the distance between the left channel speaker and the right channel speaker, and then compare the obtained distance judgment value of the display device 200 with the distance judgment value of the external device 500 to determine the setting method through the comparison result.

[0129] If the distance judgment value of display device 200 is less than the distance judgment value of external device 500, the audio data output path of display device 200 can be set to the center path, and the audio output path of external device 500 can be set to the front path. If the distance judgment value of display device 200 is greater than the distance judgment value of external device 500, the audio data output path of display device 200 can be set to the front path, and the audio output path of external device 500 can be set to the center path.

[0130] For example, such as Figure 11a As shown, the display device 200 can control the output path of audio data by setting algorithm logic, that is, setting the output paths of the left and right channels to output according to the fusion result.

[0131] If neither the display device 200 (Master) nor the external device 500 (Slave) has a center speaker, and the distance between the left and right channel speakers (L&R) in the display device 200 is less than the distance between the left and right channel speakers (L&R) in the external device 500, then the left and right channel speakers in the display device 200 are set as center speakers; the left and right channel speakers in the external device 500 are set as front L&R speakers.

[0132] If neither the display device 200 (Master) nor the external device 500 (Slave) has a center speaker, and the distance between the left and right channel speakers (L&R) in the display device 200 is greater than the distance between the left and right channel speakers (L&R) in the external device 500, then the left and right channel speakers in the display device 200 are set as front L&R speakers; the left and right channel speakers in the external device 500 are set as center speakers.

[0133] In some embodiments, after obtaining the distance judgment value between the display device and the external device, the display device 200 may also detect whether the display device 200 and the external device 500 contain a center speaker.

[0134] If both display device 200 and external device 500 include a center speaker, and the distance judgment value of display device 200 is less than the distance judgment value of external device 500, the audio output path of display device 200 is set to the front path, and the audio output path of external device 500 is set to the surround path; if both display device 200 and external device 500 include a center speaker, and the distance judgment value of display device 200 is greater than the distance judgment value of external device 500, the audio output path of display device 200 is set to the surround path, and the audio output path of external device 500 is set to the front path.

[0135] For example, such as Figure 11b As shown, the display device 200 can control the output path of audio data by setting algorithm logic, that is, setting the output paths of the left and right channels to output according to the fusion result.

[0136] If both the display device 200 (Master) and the external device 500 (Slave) have a center speaker, and the distance between the left and right channel speakers (L&R) in the display device 200 is less than the distance between the left and right channel speakers (L&R) in the external device 500, then the left and right channel speakers in the display device 200 are set as front L&Rs; the left and right channel speakers in the external device 500 are set as surround Ls&Rs.

[0137] If both the display device 200 (Master) and the external device 500 (Slave) have a center speaker, and the distance between the left and right channel speakers (L&R) in the display device 200 is less than the distance between the left and right channel speakers (L&R) in the external device 500, then the left and right channel speakers in the display device 200 are set as surround Ls&Rs; the left and right channel speakers in the external device 500 are set as front L&Rs.

[0138] In some embodiments, when the display device 200 and the speakers in the external device 500 partially overlap, the display device 200 can set the same output path for the overlapping speakers to achieve an enhancement effect on that channel. That is, when setting the output path of the audio data according to the speaker parameters, the display device 200 can traverse the installation position of the local speaker and the setting position of the external speaker in the speaker parameters. Then, based on the installation position and the setting position, it marks the overlapping channel speakers, thereby simultaneously transmitting the channel signal in the audio data corresponding to the installation position to the overlapping channel speakers.

[0139] For example, when both the display device 200 and the external device 500 include a subwoofer, since the subwoofers have the same output effect and the speaker positions overlap (usually set at a position close to the ground), when performing audio fusion, the subwoofers on both devices can be set to play audio data in the bass channel simultaneously, thereby obtaining a bass enhancement effect.

[0140] As can be seen from the above, the display device 200 can set the output path of audio data according to the method provided in the above embodiments. For example... Figure 12 As shown, in order to enable the setting of the output path, in some embodiments of this application, an audio intelligent fusion module can also be constructed in the display device 200. The audio intelligent fusion module can automatically calculate and allocate audio parameters from the two sets of devices provided by the display device 200 and the external device interface 240, and control the audio system of the display device 200 to adjust items such as link, audio parameters, and transmission time, ultimately achieving the fusion of the two systems.

[0141] The audio intelligent fusion module may include an audio output circuit, which includes multiple output paths. Each output path is equipped with a switch, a local contact, and an external contact. The local contact is connected to the local speaker, and the external contact is connected to the external device interface 240. The controller 250 is connected to the switch and, when setting the output path of the audio data according to the speaker parameters, sends a connection command to the switch according to the set output path to control the switch to connect the local contact or the external contact.

[0142] For example, taking a 2.1-channel smart TV as an example, the smart TV can have its own audio system and also support audio signal output to external audio devices via audio interfaces such as ARC, coaxial, and optical. After connecting external audio devices in a 3.1 configuration, a 5.1.2 audio output mode can be formed. When an external audio source is input, the smart TV's decoder can decode the audio data into multi-channel data. Each or each pair of channel paths has a gain adjustment unit and a delay adjustment unit, both of which are controlled by the audio system's intelligent fusion module. The switching switch is controlled by the audio intelligent fusion module to realize the fused audio system architecture, with part of the output from the local speakers and part output to external speakers through the audio output port.

[0143] When no external audio equipment is connected, the TV is a 2.1 channel system with only left, right, and subwoofer channels. The decoded multi-channel data is then mixed before being output to the speaker system. When external audio equipment is connected, the intelligent audio fusion module calculates the parameters of both systems, redistributes the channels, and switches to different channels. The TV's original left and right channels continue to handle the left and right channels, while the 3.1 soundbar handles the left, right surround, and center channels. In the audio system module, the switches perform the following actions: L&R (front path) connects to the TV speakers; Ls&Rs (surround path) connects to the multi-PCM unit packaged and sent to the speakers (soundbar) via ARC; Lt&Rt (sky path) connects and distributes the signal proportionally to the speakers in both devices; C (center path) connects to the multi-PCM unit packaged and sent to the speakers (soundbar) via ARC; LFE (subwoofer path) connects and sends the signal to the speakers in both devices.

[0144] Based on the above audio output method, in some embodiments of this application, a display device 200 is also provided, including: a display 260, a local speaker, an external device interface 240, and a controller 250. The display 260 is configured to display a user interface; the local speaker is configured to play audio data; the external device interface 240 is configured to connect to an external device 500, the external device 500 including at least one external speaker; and the controller 250 is configured to execute the following program steps:

[0145] Obtain user-input control commands for playing audio data;

[0146] In response to control commands, the speaker parameters are detected, including the number and installation location of the local speakers, as well as the number and setting location of the external speakers.

[0147] The audio data output path is set according to the speaker parameters to play audio data through the local speaker and external speakers.

[0148] Correspondingly, such as Figure 13 , Figure 14 As shown, in some embodiments, an external device 500 is also provided, including: an external speaker, an audio interface, and a processor. The external speaker is configured to output audio data; the audio interface is configured to connect to a display device 200 to acquire the audio data from the display device 200; and the processor is configured to execute the following program steps:

[0149] In response to a detection action from the display device, the available number and location of external speakers are sent to the display device to generate speaker parameters; the speaker parameters include the available number and installation location of the display device's own speakers as well as the available number and location of external speakers.

[0150] The audio data is received according to the output path set by the display device based on the speaker parameters.

[0151] Play audio data.

[0152] As can be seen from the above technical solutions, the display device 200 and external device 500 provided in the above embodiments can detect the speaker information of the display device 200 and external device 500 after the user inputs a control command to play audio data, so as to determine the available number and position of the local speaker and the external speaker. Then, according to the available number and spatial position of the speakers, the output path of the audio data is set so as to play the audio data through the local speaker and the external speaker. The display device 200 can enable audio data to be output simultaneously through the local speaker and the external speaker, and form a fusion effect according to the playback mode adapted to the speaker position, increasing the number of audio output channels or enhancing the output effect of some output channels to meet the user's needs for audio output effect.

[0153] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.

Claims

1. A display device, characterized in that, include: monitor; The local speaker is configured to play audio data; An external device interface is configured to connect to an external device, said external device including at least one external speaker; The controller is configured as follows: Obtain control commands for playing audio data; In response to the control command, the speaker parameters are detected; In the case where the local speaker and the external speaker do not include a center speaker, a distance judgment value is determined between the display device and the external device based on the speaker parameters; the output path of the audio data is set according to the distance judgment value; wherein, the distance judgment value is the distance between the left channel speaker and the right channel speaker; the output path of the audio data includes the audio output path of the display device and the audio output path of the external device, the audio data output path of the display device is either a center path or a front path, and the audio output path of the external device is either a front path or a center path; When the local speaker and the external speaker include the center speaker, a distance judgment value is determined in the display device and the external device according to the speaker parameters; the output path of the audio data is set according to the distance judgment value; wherein, the audio data output path of the display device is a front path or a surround path; the audio output path of the external device is a surround path or a front path.

2. The display device according to claim 1, characterized in that, The controller is further configured to: Obtain the identification information of the display device; Record the output path; Based on the output path and the identification information of the display device, audio configuration strategy information is generated; The audio configuration policy information is sent to the external device so that the external device plays the audio data according to the output path.

3. The display device according to claim 1, characterized in that, The speaker parameters include the available number and installation location of the native speakers and the available number and placement location of the external speakers. The controller is further configured to: In the step of setting the output path of the audio data according to the speaker parameters, the total number of the local speaker and the external speaker is calculated; Decoding is performed on the audio data according to the total quantity to obtain multi-channel data, wherein the number of channels in the multi-channel data is equal to the total quantity; According to the installation location and the placement location, the multi-channel data is transmitted to each of the local speakers or external speakers.

4. The display device according to claim 3, characterized in that, The controller is further configured to: In the step of calculating the total number of the local speaker and the external speaker, the audio output modes of the display device and the external device are obtained; The fusion result is queried from a preset fusion data table according to the audio output mode. The fusion result includes a new output mode that is different from the display device and the external device. Iterate through the number of speakers required for the new output mode to obtain the total number.

5. The display device according to claim 1, characterized in that, The controller is further configured to: In the step of setting the audio data output path according to the distance judgment value, if the distance judgment value of the display device is less than the distance judgment value of the external device, the audio data output path of the display device is set as the center path, and the audio output path of the external device is set as the front path; If the distance judgment value of the display device is greater than the distance judgment value of the external device, the audio data output path of the display device is set as the front path, and the audio output path of the external device is set as the center path.

6. The display device according to claim 5, characterized in that, The controller is further configured to: After determining the distance judgment value between the display device and the external device, it is detected whether the display device and the external device contain a center speaker; If the display device and the external device both contain a center speaker, and the distance judgment value of the display device is less than the distance judgment value of the external device, the audio output path of the display device is set to the front path, and the audio output path of the external device is set to the surround path. When both the display device and the external device include a center speaker, and the distance judgment value of the display device is greater than the distance judgment value of the external device, the audio output path of the display device is set to a surround path, and the audio output path of the external device is set to a front path.

7. The display device according to claim 1, characterized in that, The controller is further configured to: In the step of setting the output path of the audio data according to the speaker parameters, the installation position of the local speaker and the placement position of the external speaker in the speaker parameters are traversed. Mark the overlapping channel loudspeakers according to the installation location and the placement location; The channel signal in the audio data corresponding to the installation position is simultaneously transmitted to the overlapping channel speaker.

8. The display device according to claim 1, characterized in that, It also includes an audio output circuit, which includes multiple output paths. Each output path is provided with a switch, a local contact, and an external contact. The local contact is connected to the local speaker, and the external contact is connected to the external device interface. The controller is connected to the switch, and the controller is further configured to: In the step of setting the output path of the audio data according to the speaker parameters, a connection command is sent to the switch according to the set output path to control the switch to connect the local contact or the external contact.

9. An external device, characterized in that, include: An external speaker is configured to output audio data. An audio interface is configured to connect to a display device to obtain the audio data from the display device; The processor is configured as follows: In response to the detection action of the display device, the available number and placement position of the external speakers are sent to the display device to generate speaker parameters; Audio data is received according to the audio output path set by the display device based on the distance judgment value between the display device and the external device determined by the speaker parameters; wherein, the distance judgment value is the distance between the left channel speaker and the right channel speaker; the audio data output path includes the audio output path of the display device and the audio output path of the external device, the audio data output path of the display device is a center path or a front path, and the audio output path of the external device is a front path or a center path; Play the audio data.

10. An audio output method, characterized in that, Applied to a display device, the display device including a built-in speaker, the display device connected to an external device, the external device including an external speaker, the audio output method includes: Obtain control commands for playing audio data; In response to the control command, the speaker parameters are detected; In the case where the local speaker and the external speaker do not include a center speaker, a distance judgment value is determined between the display device and the external device based on the speaker parameters; the output path of the audio data is set according to the distance judgment value; wherein, the distance judgment value is the distance between the left channel speaker and the right channel speaker; the output path of the audio data includes the audio output path of the display device and the audio output path of the external device, the audio data output path of the display device is either a center path or a front path, and the audio output path of the external device is either a front path or a center path; When the local speaker and the external speaker include the center speaker, a distance judgment value is determined in the display device and the external device according to the speaker parameters; the output path of the audio data is set according to the distance judgment value; wherein, the audio data output path of the display device is a front path or a surround path; the audio output path of the external device is a surround path or a front path.

11. A display device, characterized in that, include: monitor; The local speaker is configured to play audio data; An external device interface is configured to connect to an external device, said external device including at least one external speaker; The controller is configured as follows: Obtain control commands for playing audio data; In response to the control command, the speaker parameters are detected; In the case where the local speaker and the external speaker do not include a center speaker, a distance judgment value is determined between the display device and the external device based on the speaker parameters; the output path of the audio data is set according to the distance judgment value; wherein, the distance judgment value is the distance between the left channel speaker and the right channel speaker; the output path of the audio data includes the audio output path of the display device and the audio output path of the external device, wherein the audio output path of the display device is either a center path or a front path, and the audio output path of the external device is either a front path or a center path; Based on the output path of the audio data, the audio data is played through the local speaker and the external speaker.

Images