Display device and audio output method

By introducing multiple audio output interfaces and controllers into the display device, switching and adjusting the audio device, so that each window can play audio independently, solving the problem of only one window in the multi-window mode in the prior art, and improving the problem of User experience.

CN114302070BActive Publication Date: 2024-11-08HISENSE VISUAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110481435.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-30
Publication Date
2024-11-08
Estimated Expiration
2041-04-30

AI Technical Summary

Technical Problem

In multi-window mode, existing display devices can only select one window to play sound, resulting in poor user experience.

Method used

By introducing multiple audio output interfaces and controllers into the display device, the focus window controlled by the user is detected, and the audio equipment of the focus window is switched according to the user's instructions, and the audio equipment of the other windows is adjusted at the same time, so that each window can use different audio independently equipment.

Benefits of technology

It realizes multiple windows to play audio independently at the same time, improves user experience and meets the diverse needs of users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114302070B_ABST
    Figure CN114302070B_ABST
Patent Text Reader

Abstract

The present application provides a display device and an audio output method, wherein the display device includes a display and an audio output interface controller. The display is used to display a user interface, which includes multiple windows; there are multiple audio output interfaces for connecting multiple types of audio devices; the controller is configured to: respond to a display instruction of multiple windows indicated by a user input, and control the display to display multiple windows; detect the focus window where the focus controlled by the user is located; respond to a switching instruction of the audio device corresponding to the focus window indicated by the user input, switch the audio device corresponding to the focus window, and adjust the audio devices corresponding to the remaining windows, so that each window uses a different audio device, so that each window can play audio independently, thereby improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and an audio output method. Background Art

[0002] With the rapid development of intelligent display devices, the functions of display devices will become more and more abundant, and the performance will become more and more powerful. They can realize two-way human-computer interaction, integrate multiple functions such as audio and video, entertainment, and data, and meet the diverse and personalized needs of users. As users' requirements for the functions or services that display devices can provide are getting higher and higher, split-screen display has gradually become a function that users often use.

[0003] For some display devices, the picture displayed on the monitor can be split into multiple windows, and each window displays different picture content, so that users can watch different program pictures at the same time.

[0004] However, the inventor of the present application discovered that although the existing display device can display different pictures through multiple windows, it will only select one of the windows to play sound, that is, it allows the user to watch multiple program pictures, but the sound of one of the program pictures will be played, while the sound of the remaining program pictures cannot be played, which seriously affects the user experience. Summary of the invention

[0005] The present invention provides a display device and an audio output method to solve the problem that in the existing display device, only one window among multiple windows can play sound, resulting in poor user experience.

[0006] In a first aspect, the present application provides a display device, which includes a display, an audio output interface, and a controller. The display is used to display a user interface, which includes multiple windows; there are multiple audio output interfaces for connecting multiple types of audio devices; the controller is configured to perform the following steps: respond to a display instruction input by a user to display multiple windows, control the display to display multiple windows; detect the focus window where the focus controlled by the user is located; respond to a switching instruction input by a user to switch the audio device corresponding to the focus window, switch the audio device corresponding to the focus window, and adjust the audio devices corresponding to the remaining windows so that each window uses a different audio device.

[0007] In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from the second category audio device to the first category audio device.

[0008] In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine the use status of the first type of audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the first type of audio device is in an unused state, connect the first audio channel and the first type of audio device; when the first type of audio device is in a used state, determine the first switching window currently corresponding to the first type of audio device; set the second audio channel of the first switching window to a mute state, and the second audio channel is used to output the audio of the first switching window to the audio device corresponding to the first switching window; connect the second audio channel to the second type of audio device corresponding to the focus window, and connect the first audio channel to the first type of audio device; release the mute state of the second audio channel; release the mute state of the first audio channel.

[0009] In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from a first type of audio device to a second type of audio device.

[0010] In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine whether the audio output interface is connected to an unused second-category audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the audio output interface is connected to an unused second-category audio device, connect the first audio channel to the unused second-category audio device; when the audio output interface is not connected to an unused second-category audio device, randomly select a first device from the second-category audio devices, and determine the second switching window currently corresponding to the first device; set the third audio channel of the second switching window to a mute state, the third audio channel is used to output the audio of the second switching window to the audio device corresponding to the second switching window; connect the third audio channel to the first-category audio device, and connect the first audio channel to the first device; release the mute state of the third audio channel; release the mute state of the first audio channel.

[0011] In some implementations, before executing the steps of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: respond to a query instruction input by a user to query the audio device corresponding to the focus window, control the display to display the audio device usage status, so that the user can switch the audio device corresponding to the focus window to a specific audio device according to the audio device usage status; the audio device usage status includes all audio devices that can be used by the display device and the window currently corresponding to each audio device.

[0012] In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from a first-category audio device to a specific second-category audio device.

[0013] In the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: set the first audio channel of the focus window to a mute state, and determine the use state of the specific second-category audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; when the specific second-category audio device is in an unused state, connect the first audio channel and the specific second-category audio device; when the specific second-category audio device is in a used state, determine the specific switching window currently corresponding to the specific second-category audio device; set the specific audio channel of the specific switching window to a mute state, the specific audio channel is used to output the audio of the specific switching window to the audio device corresponding to the specific switching window; connect the specific audio channel to the first-category audio device, and connect the first audio channel to the specific second-category audio device; release the mute state of the specific audio channel; release the mute state of the first audio channel.

[0014] In some implementations, the user interface includes a first window and a second window. When the audio device corresponding to the first window is a first-category audio device, the audio device corresponding to the second window is a second-category audio device; when the audio device corresponding to the first window is a second-category audio device, the audio device corresponding to the second window is the first-category audio device or the remaining second-category audio devices.

[0015] In some implementations, before executing the step of controlling the display to display multiple windows, the controller is further configured to: in response to a power-on instruction input by a user indicating to turn on the display device, control the display to display a first window, wherein the first window is used to play a first media resource. In executing the step of controlling the display to display multiple windows, the controller is further configured to: in response to the display instruction, control the display to simultaneously display the first window and the second window, wherein the second window is used to display a media resource recommendation list, so that the user can select a second media resource according to the media resource recommendation list; and play the second media resource in the second window.

[0016] In some implementations, the switching instruction is: switching the audio device corresponding to the focus window from the first device in the second category of audio devices to the second device in the second category of audio devices; wherein the focus window is the first window, and the second device is the audio device currently corresponding to the second window. In executing the step of switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, the controller is further configured to: connect the audio channel of the first window to the second device, and connect the audio channel of the second window to the first device.

[0017] In some implementations, the controller is further configured to: in response to a control instruction input by a user indicating switching of the user interface from multiple windows to a single window, control the display to display only the focus window; and set the audio channels of the remaining windows to a mute state.

[0018] In a second aspect, the present application also provides an audio output method, which is applied to a display device, and the method includes: responding to a display instruction of displaying multiple windows in response to an instruction input by a user, controlling the display to display multiple windows; detecting a focus window where the focus controlled by the user is located; responding to a switching instruction of switching the audio device corresponding to the focus window in response to an instruction input by the user, switching the audio device corresponding to the focus window, and adjusting the audio devices corresponding to the remaining windows so that each window uses a different audio device.

[0019] It can be seen from the above technical solution that the present application provides a display device and an audio output method, which can control the display to display multiple windows and detect the focus window where the focus controlled by the user is located; by switching the audio device corresponding to the focus window and adjusting the audio devices corresponding to the remaining windows, so that each window uses a different audio device, each window can play audio independently, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] Figure 1 shows a usage scenario of a display device according to some embodiments;

[0022] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;

[0023] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0024] Figure 4 shows a software configuration diagram in a display device 200 according to some embodiments;

[0025] Figure 5 A flowchart of the interaction between components of a display device in some embodiments is shown;

[0026] Figure 6 A schematic diagram of a screen in a display in a multi-window mode in a feasible embodiment is shown;

[0027] Figure 7 A schematic diagram showing a multi-window mode in a feasible embodiment is shown;

[0028] Figure 8 A schematic diagram showing an audio output method in a multi-window mode in a feasible embodiment;

[0029] Fig. 9 A schematic diagram of a focus window in a feasible embodiment is shown;

[0030] Fig.10 A flowchart of the interaction between components of a display device in some embodiments is shown;

[0031] Fig.11 A schematic diagram showing an audio device corresponding to a focus window displayed on a display in a feasible embodiment is shown;

[0032] Fig.12 A flowchart of the interaction between components of a display device in some embodiments is shown;

[0033] Fig.13 A schematic diagram showing an audio device corresponding to a focus window displayed on a display in a feasible embodiment is shown;

[0034] Fig.14A schematic diagram showing a display device switching from a multi-window mode to a single-window mode in a feasible embodiment is shown;

[0035] Fig.15 A flow chart of an embodiment of an audio output method is shown. DETAILED DESCRIPTION

[0036] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0037] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0038] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0039] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0040] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0041] Figure 1 Schematic diagram of a usage scenario of a display device according to an embodiment. Figure 1 As shown, the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0042] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and at least one of other short-range communication methods, to control the display device 200 wirelessly or wired. The user may control the display device 200 by inputting user commands through at least one of buttons on the remote controller, voice input, and control panel input.

[0043] In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a laptop computer, an AR / VR device, etc.

[0044] In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 may be controlled using an application running on the smart device.

[0045] In some embodiments, the smart device 300 and the display device may also be used to communicate data.

[0046] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0047] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0048] In some embodiments, the software steps executed by a step execution subject can be migrated to another step execution subject in data communication with it as needed for execution. Exemplarily, the software steps executed by a server can be migrated to a display device in data communication with it as needed for execution, and vice versa.

[0049] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.

[0050] In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.

[0051] In some embodiments, the user input / output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button, or alternative modules.

[0052] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0053] In some embodiments, the display apparatus 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0054] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0055] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from a controller, display video content, image content, and a menu control interface component and a user control UI interface, etc.

[0056] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0057] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0058] In some embodiments, the communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0059] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0060] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0061] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0062] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0063] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. Operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.

[0064] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0065] CPU processor. Used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video content. CPU processor may include multiple processors. For example, it includes a main processor and one or more sub-processors.

[0066] In some embodiments, the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input command display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes; and a renderer, which renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.

[0067] In some embodiments, the video processor is used to receive an external video signal and perform at least one of the following video processing operations, such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis, according to a standard codec protocol of the input signal, to obtain a signal that can be directly displayed or played on the display device 200.

[0068] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, and a display formatting module. The demultiplexing module is used to demultiplex the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting an RGB data signal.

[0069] In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

[0070] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0071] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on a display screen of an electronic device, wherein a control may include at least one of icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0072] In some embodiments, the user interface 280 is an interface that can be used to receive control input (such as a physical button on the display device body, or other interfaces).

[0073] In some embodiments, the system of the display device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together constitute the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0074] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0075] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0076] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0077] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0078] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).

[0079] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0080] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0081] For some display devices, the screen displayed on the display can be split to form multiple windows, and each window displays different screen content, so that users can watch different program screens at the same time. However, although the existing display devices can display different screens through multiple windows, only one of the windows will be selected to play the sound, that is, the user is allowed to watch multiple program screens, but the sound of one program screen will be played, while the other program screens cannot play the sound, which seriously affects the user experience.

[0082] In order to solve the above technical problems, the present application provides a display device, including a display, an audio output interface and a controller. The display is used to display a user interface; the audio output interface includes multiple types of audio interfaces, which are respectively used to connect multiple types of audio devices.

[0083] In some embodiments, the audio output interface in the display device may include a first-class audio interface and a second-class audio interface, wherein the first-class audio interface is used to connect a first-class audio device, and the second-class audio interface is used to connect a second-class audio device. The first-class audio device may be an audio device such as a speaker or sound box built into the display device. The second-class audio device may be a Bluetooth speaker, USB speaker, or soundbar speaker connected to the display device.

[0084] In some embodiments, the display device may be provided with a first-class audio interface and multiple second-class audio interfaces. That is, the display device may be connected to a first-class audio device and multiple second-class audio devices, and play audio content. For example, the display device may have a built-in speaker and two external Bluetooth speakers.

[0085] In some embodiments, the display device has a split screen function, which can divide the user interface displayed in the display into multiple windows, and each window can display different screen contents, that is, the display device has a multi-window mode. In the multi-window mode, the display device can display multiple windows at the same time, so that the user can view different screen contents in one display device.

[0086] Figure 5 The following is a flowchart of the interaction between the components of the display device in some embodiments. When the display device displays a user screen and there is only one window in the user screen, the user can input a display instruction to display multiple windows, i.e., a multi-window mode instruction, to the display device. When the controller receives the multi-window mode instruction, it can control the display to change from displaying one window to displaying multiple windows.

[0087] In some embodiments, the user can send a multi-window mode instruction to the display device by operating a designated button of the remote control. In the actual application process, the correspondence between the multi-window mode instruction and the remote control button is pre-bound. For example, a multi-window mode button is set on the remote control. When the user touches the button, the remote control sends a multi-window mode instruction to the controller. At this time, the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows. When the user touches the button again, the controller can control the display device to exit the multi-window mode.

[0088] In some embodiments, the correspondence between the multi-window mode command and multiple remote control buttons can also be pre-bound. When the user touches multiple buttons bound to the multi-window mode command, the remote control issues the multi-window mode command. In a feasible embodiment, the buttons bound to the multi-window mode command are the direction keys (left, down, left, down) in sequence, that is, when the user continuously touches the buttons (left, down, left, down) within a preset time, the remote control sends the multi-window mode command to the controller. The above binding method can prevent the multi-window mode command from being issued due to user's misoperation.

[0089] The embodiments of the present application only provide several exemplary binding relationships between multi-window mode commands and buttons. In actual application, the binding relationship between multi-window mode commands and buttons can be set according to the user's habits, and no excessive limitations are made here.

[0090] In some embodiments, when a user uses a smart device to control a display device, such as a mobile phone, a multi-window mode instruction can also be sent to the display device. In actual application, a split-screen control can be set in the mobile phone, and the split-screen control can be used to select whether to enter the multi-window mode and set the number of windows, thereby sending a multi-window mode instruction to the controller, and the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.

[0091] In some embodiments, when a user uses a mobile phone to control a display device, a continuous click instruction can be issued to the mobile phone. A continuous click instruction means that within a preset period, the number of times the user clicks on the same area of ​​the mobile phone touch screen exceeds a preset threshold. For example, when a user clicks on a certain area of ​​the mobile phone touch screen three times in a row within 1 second, it is regarded as a continuous click instruction. After receiving the continuous click instruction, the mobile phone can send a multi-window mode instruction to the display device so that the controller controls the display device to enter the multi-window mode and controls the display to display multiple windows.

[0092] In some embodiments, when a user uses a mobile phone to control a display device, it can also be set as follows: when it is detected that the touch pressure value of a certain area of ​​the mobile phone touch screen by the user exceeds a preset pressure threshold, the mobile phone can send a multi-window mode instruction to the display device.

[0093] A multi-window mode switching option may also be set in the UI interface of the display device. When the user clicks the switching option, the display device may be controlled to enter or exit the multi-window mode.

[0094] In some embodiments, two windows may be displayed in the multi-window mode, or more than two windows may be displayed. Figure 6 A schematic diagram of a screen in a display in a multi-window mode in a feasible embodiment is shown. After the display device enters the multi-window mode, a first window and a second window are simultaneously displayed in the display, wherein the first window and the second window can respectively display different screen contents, the first window displays the screen content of the first media resource, and the second window displays the screen content of the second media resource.

[0095] In some embodiments, when the screen contents displayed in multiple windows are different, the screen types displayed in the multiple windows can be made the same. For example, when the screen contents of the first media resource are displayed in the first window, the screen contents of the second media resource can be displayed in the second window. At this time, the screen types displayed in the two windows are the same, both of which are media resources. It can also be set that the screen types displayed in multiple windows are different in different usage scenarios. For example, when the screen contents of the media resource are displayed in the first window, the UI interface or the game interface is displayed in the second window. At this time, the screen types displayed in the two windows are different. Thereby, different needs of users can be met and the user experience is enhanced.

[0096] In some embodiments, the multi-window mode can be set according to the user's usage status. When it is detected that the user turns on the display device, the display device defaults to single-window mode, that is, only the first window is displayed in the display, and the first window can be displayed in full screen or in windowed mode. The display device can play the first media resource in the first window.

[0097] When the first media resource is played in the first window, if the user sends a multi-window mode instruction to the display device, the program recommendation interface can be entered first. Figure 7 A schematic diagram of a multi-window mode in a feasible embodiment is shown, in which a media resource recommendation list is displayed on the right side of the first window, including multiple recommended program options. If the user selects the recommended program 2 option and confirms it, the display device can be controlled to enter the multi-window mode. At this time, the first media resource is still displayed through the first window, while the second window displays the recommended program 2 selected by the user.

[0098] In some embodiments, when the display device is in multi-window mode, while multiple windows simultaneously display different screen contents, the audio content corresponding to each screen can also be output separately. The display device can use a first-class audio device and multiple second-class audio devices to play audio at the same time. For example, the display device is connected to a built-in speaker and two external Bluetooth speakers at the same time. At this time, the display device can use these three audio devices to output the audio content of the three windows respectively. At the same time, each window can output audio to the audio device corresponding to each window through its own audio channel, and play the audio content through the audio device.

[0099] In some embodiments, the display device can be set to two audio device modes. One is a built-in playback mode, in which the audio content corresponding to the window can be played using the first type of audio device built into the display device. The other is an external playback mode, in which the audio content corresponding to the window is played by using a second type of audio device, such as a Bluetooth speaker.

[0100] Figure 8 A schematic diagram of an audio output method in a multi-window mode in a feasible embodiment is shown. In which, the display device is in a multi-window mode, in which a first media resource is played in a first window, and a first type of audio device is used to output audio; a second media resource is played in a second window, and a second type of audio device is used to output audio.

[0101] Alternatively, both the first window and the second window may use a second-class audio device to output audio, that is, the first window uses a first device to output audio, and the second window uses a second device to output audio. The first device and the second device in the embodiment of the present application are both second-class audio devices. It should be noted that since each window plays audio through a different audio device, the audio of each screen in the multi-window mode can be played independently to achieve the purpose of non-interference.

[0102] Therefore, to ensure that the audio of all windows in multi-window mode can be played normally, it can be set as follows: when the audio device corresponding to the first window is a first-class audio device, the audio device corresponding to the second window is a second-class audio device. When the audio device corresponding to the first window is a second-class audio device, the audio device corresponding to the second window is a first-class audio device or the remaining second-class audio device. This ensures that the audio devices used by each window are different.

[0103] The controller can receive various control instructions input by the user during use, and perform corresponding interactive actions according to these control instructions, so as to control each window, such as image quality control and sound control.

[0104] In some embodiments, the display device can detect the focus window in real time. The focus window refers to the window where the focus controlled by the user is located. Focus refers to a sign used by the display device to assist users in human-computer interaction, which can highlight the user's current selection. For example, the focus can be a selection box, which displays the content selected by the user through methods such as "deepening display" and "highlighting display". The user can control the selection box through the "up, down, left, right" direction keys on the remote control to select different options. The focus can be on a certain option in the window, or on the entire window. As long as the focus is within the overall range of a window, the window is the focus window. Fig. 9 A schematic diagram of a focus window in a feasible embodiment is shown, wherein the user interface includes a first window and a second window, wherein the focus is in the form of a selection box. At this time, the selection box selects an option in the first window, so the first window is the focus window, and the user can also select other options in the first window to adjust the first window.

[0105] The display device can respond to various user operations in a timely manner by detecting the focus window in real time. Fig.10 The present invention is a flowchart showing the interaction between the components of the display device in some embodiments.

[0106] In some embodiments, while the display device detects the focus window in real time, the controller can also obtain the audio device currently corresponding to the focus window. For example, it can be obtained through a database in the display device that records the audio device currently used by each window. The controller can determine the focus window according to the focus position, and if the focus window is the first window, the audio output device currently used by the first window can be obtained from the database.

[0107] In some embodiments, the display device can display the audio device mode status to the user, and the audio device mode status refers to: the audio device currently corresponding to the focus window and the audio device mode that can be switched, so that the user can switch the audio device mode of the focus window. The user can send a display instruction to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the display instruction and the remote control button is pre-bound. For example, a display button is set on the remote control. When the user touches the button, the remote control sends a display instruction to the controller. At this time, the controller controls the display to display the audio device currently corresponding to the focus window, as well as the switchable audio device mode.

[0108] Alternatively, the user calls up the setting key UI menu, and the controller controls the OSD layer menu to display the audio device corresponding to the current window and the switchable audio device modes.

[0109] Fig.11A schematic diagram of an audio device corresponding to a focus window displayed on a display in a feasible embodiment is shown, wherein the user interface includes a first window and a second window, and the first window is the focus window. When a user's display instruction is detected, the audio device currently corresponding to the first window, i.e., the first type of audio device, and the audio device mode that the first window can switch, i.e., the second type of audio device, are displayed in the first window. The user can choose to switch the audio device of the first window from the first type of audio device to the second type of audio device, or not to switch.

[0110] When a switching instruction indicating switching the audio device corresponding to the focus window is detected, the display device can switch the audio device corresponding to the focus window in response to the switching instruction input by the user. At the same time, in order to ensure that each window can still play audio independently, the audio devices corresponding to the remaining windows can also be adjusted, so as to ensure that each window uses a different audio device.

[0111] In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to the first-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.

[0112] Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.

[0113] After the first audio channel is set to a muted state, the current usage state of the first audio device can be determined. If the first audio device is not in use, it means that no window is currently using the first audio device. The first audio channel can be directly connected to the first audio device, and the muted state of the first audio channel can be released. This allows the focus window to output audio to the first audio device through the first audio channel and use the first audio device to play audio.

[0114] If the first type of audio device is in use, it means that other windows are using the first type of audio device. At this time, the audio devices of the window and the focus window can be exchanged, so that the focus window can use the first type of audio device. Before exchanging audio devices, the controller can detect the window currently corresponding to the first type of audio device and set it as the first switching window, and at the same time set the second audio channel of the first switching window to a muted state to prevent popping sounds. The controller then connects the second audio channel to the second type of audio device corresponding to the focus window, and connects the first audio channel to the first type of audio device. At this point, the audio devices between the focus window and the first switching window are exchanged. The controller then unmutes the first audio channel and the second audio channel, so that the focus window can use the first type of audio device to play audio, and each window can still play audio independently without being affected.

[0115] In some embodiments, if the audio device currently corresponding to the focus window is a first category audio device, and the user instructs to switch the audio device corresponding to the focus window from the first category audio device to the second category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.

[0116] Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.

[0117] After the first audio channel is set to a muted state, considering that the display device can be connected to multiple second-class audio devices, it can be determined whether the display device is currently connected to an unused second-class audio device. If there is an unused second-class audio device, the first audio channel can be directly connected to an unused second-class audio device, so that the focus window can output audio to the second-class audio device through the first audio channel, and use the second-class audio device to play audio.

[0118] If the display device is not connected to an unused second-class audio device, it means that all second-class audio devices are used by other windows. At this time, a second-class audio device can be randomly selected for use, so that the focus window can use the second-class audio device. Before switching the audio device, the controller can randomly select a second-class audio device, that is, the first device, and determine the second switching window currently corresponding to the second-class audio device, and at the same time set the third audio channel of the second switching window to a mute state to prevent popping sounds.

[0119] The controller then connects the third audio channel to the first type of audio device, and connects the first audio channel to the first device. At this point, the audio devices between the focus window and the second switching window are swapped. The controller then unmutes the first audio channel and the third audio channel, so that the focus window can use the first device to play audio, while each window can still play audio independently without being affected.

[0120] Fig.12 The present invention is a flowchart showing the interaction between the components of the display device in some embodiments.

[0121] In some embodiments, the display device can display the audio device currently corresponding to the focus window and the usage of the displayed audio device to the user. Among them, the audio device usage may include all audio devices that the display device can use and the window currently corresponding to each audio device. The user selects the audio device of the focus window according to the usage of the audio device and switches to the selected specific audio device. The user can send a query instruction to the display device by operating the designated button of the remote control. In the actual application process, the correspondence between the query instruction and the remote control button is pre-bound. For example, a query button is set on the remote control. When the user touches the button, the remote control sends a query instruction to the controller. At this time, the controller controls the display to display the audio device currently corresponding to the focus window, as well as the usage of the audio device.

[0122] Alternatively, the user may call up a setting key UI menu, and the controller may control the OSD layer menu to display the audio device corresponding to the current window and the usage of the audio device.

[0123] Fig.13 A schematic diagram of an audio device corresponding to a focus window displayed on a display in a feasible embodiment is shown, wherein the user interface includes a first window, a second window, and a third window, and the first window is a focus window. When a user's query instruction is detected, the audio device currently corresponding to the first window is displayed in the first window, which is a first-class audio device. And the usage of the audio device, that is: the first-class audio device currently corresponds to the first window, the first device currently corresponds to the second window, and the second device currently corresponds to the third window. The user can choose to switch the audio device of the first window from the first-class audio device to the first device or the second device, or not to switch.

[0124] In some embodiments, if the audio device currently corresponding to the focus window is a first category audio device, and the user instructs to switch the audio device corresponding to the focus window from the first category audio device to a specific second category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.

[0125] Before switching the audio device, the controller may first set the first audio channel of the focus window to a mute state to prevent popping sound when switching the audio device.

[0126] After setting the first audio channel to a mute state, the controller may determine a usage state of the specific second-category audio device.

[0127] After the first audio channel is set to a muted state, the current usage state of the specific second-class audio device can be determined. If the specific second-class audio device is not in use, it means that no window is currently using the first-class audio device. The first audio channel can be directly connected to the specific second-class audio device, and the muted state of the first audio channel can be released. This allows the focus window to output audio to the specific second-class audio device through the first audio channel, and use the specific second-class audio device to play audio.

[0128] If a specific second-class audio device is in use, it means that other windows are using the specific second-class audio device. At this time, the audio devices of the window and the focus window can be exchanged, so that the focus window can use the specific second-class audio device. Before exchanging audio devices, the controller can detect the window currently corresponding to the specific second-class audio device and set it as a specific switching window, and at the same time set the specific audio channel of the specific switching window to a muted state to prevent popping sounds. The controller then connects the specific audio channel to the first-class audio device, and connects the first audio channel to the specific second-class audio device. At this point, the audio devices between the focus window and the specific switching window are exchanged. The controller then unmutes the first audio channel and the second audio channel, so that the focus window can use the specific second-class audio device to play audio, and each window can still play audio independently without being affected.

[0129] In some embodiments, when it is detected that a specific second-category audio device currently corresponds to a specific switching window, it can also be detected whether the display device is currently connected to an unused second-category audio device. If so, the specific switching window is connected to the unused second-category audio device, and the focus window is connected to the specific second-category audio device. If there is no unused second-category audio device, the audio device between the focus window and the specific switching window is exchanged.

[0130] In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to the first-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction. The controller can exchange the audio devices of the focus window and the window currently corresponding to the first-category audio device. The specific exchange method can refer to the above-mentioned embodiment of switching the audio device corresponding to the focus window from the first-category audio device to a specific second-category audio device, which will not be repeated here.

[0131] In some embodiments, if the audio device currently corresponding to the focus window is a second-category audio device, and the user instructs to switch the audio device corresponding to the focus window from the second-category audio device to a specific second-category audio device, the display device can switch the audio device corresponding to the focus window in response to the switching instruction.

[0132] The controller may first determine the usage of the specific second-class audio device. If the specific second-class audio device is not in use, the first audio channel is directly connected to the specific second-class audio device. If the specific second-class audio device is in use, the focus window and the specific switching window currently corresponding to the specific second-class audio device may be directly exchanged for audio devices. The specific exchange method may refer to the content in the above embodiment, which will not be repeated here.

[0133] In some embodiments, the display device may package the audio data of the window and transmit it to the second type audio device. When the display device is connected to one second type audio device or multiple second type audio devices, the method of packaging the audio data is also different.

[0134] When the display device is connected to a second-class audio device, the audio data of the window can be packaged separately for left and right channels, and the left channel packaged data and the right channel packaged data are transmitted to the second-class audio device respectively. When the display device is connected to two second-class audio devices, the audio data of the same window will be packaged together, that is, each window has only one packaged data, and then the packaged data will be transmitted to the corresponding second-class audio device.

[0135] In some embodiments, when the display device is in multi-window mode, the user can also control the display device to enter single-window mode. The user selects the focus window and can control the display device to enter single-window mode by touching the single-window mode button twice. At this time, the controller can control the display to display only the focus window or display the focus window in full screen.

[0136] In some embodiments, when the display device switches from multi-window mode to single-window mode, the currently used audio device can be controlled to be the audio device corresponding to the focus window, and the audio channels of all other windows can be set to mute mode, that is, the display device only uses the audio device corresponding to the focus window to play audio.

[0137] In some embodiments, if the focus window uses a second-class audio device to play audio, and there are other windows that also use the second-class audio device to play audio, when switching the multi-window mode to the single-window mode, it is also necessary to change the packaging method of the audio data, and change it to packaging the audio data of the focus window separately into left and right channels, and transmit them to the second-class audio device respectively.

[0138] In some embodiments, when the display device switches from the multi-window mode to the single-window mode, the first type of audio device may also be set as the default audio device, and the currently used audio device may be controlled to be the first type of audio device.

[0139] Fig.14 A schematic diagram of a display device switching from a multi-window mode to a single-window mode in a feasible embodiment is shown, wherein a user interface includes a first window and a second window, the first window is a focus window, and audio is played through a first-class audio device. When the display device switches from the multi-window mode to the single-window mode, the controller can control the display to display the first window in full screen and use the first-class audio device to play audio.

[0140] It should be noted that the multiple windows in the multi-window mode described in the embodiment of the present application can be displayed on the same display of the display device, or on different multiple displays. For example, the display device can be a dual-screen smart point TV, that is, it can include a first display and a second display. Among them, the first display is the main screen that can display a specific user interface, and the second display is the sub-screen that can display a specific interface. After entering the multi-window mode, the display device can control the display of different windows in the first display and the second display, respectively, so as to output specific display screen content at the same time. For the case where multiple windows are displayed in different displays, the display device can also adjust the volume of the display device 200 by running the above-mentioned multi-window volume adjustment method to improve the user experience.

[0141] The present application also provides an audio output method, which is applied to a display device, such as Fig.15 As shown, the method includes:

[0142] Step 1501, in response to a display instruction input by a user indicating to display multiple windows, controlling a display to display multiple windows;

[0143] Step 1502: Detect the focus window where the focus controlled by the user is located;

[0144] Step 1503: In response to a switching instruction input by the user indicating to switch the audio device corresponding to the focus window, the audio device corresponding to the focus window is switched, and the audio devices corresponding to the remaining windows are adjusted so that each window uses a different audio device.

[0145] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0146] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0148] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, It is characterized in that include: A display, used to display a user interface, wherein the user interface includes a plurality of windows; An audio output interface, used to connect a first-category audio device and / or a second-category audio device; the first-category audio device is an audio device built into the display device, and the second-category audio device is an audio device externally connected through the audio output interface; The controller is configured as: In response to a display instruction input by a user indicating to display multiple windows, controlling the display to display the multiple windows; the multiple windows output audio through different audio devices; Detecting a focus window where a focus controlled by a user is located, wherein the focus window outputs audio through a second type of audio device; In response to a switching instruction input by a user indicating that the audio device corresponding to the focus window is switched from the second type of audio device to the first type of audio device, a first audio channel of the focus window is set to a mute state, and a usage state of the first type of audio device is determined; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; When the first-category audio device is not in use, connecting the first audio channel to the first-category audio device and unmuting the first audio channel; When the first-category audio device is in use, determining a first switching window currently corresponding to the first-category audio device, and setting a second audio channel of the first switching window to a mute state; connecting the second audio channel to the second-category audio device corresponding to the focus window, and connecting the first audio channel to the first-category audio device; and releasing the mute state of the second audio channel and the first audio channel; The second audio channel is used to output the audio of the first switching window to an audio device corresponding to the first switching window.

2. The display device according to claim 1, It is characterized in that When the focus window outputs audio through the first type of audio device, the controller is further configured to: In response to a switching instruction input by a user indicating that the audio device corresponding to the focus window is switched from a first-category audio device to a second-category audio device, a first audio channel of the focus window is set to a mute state, and it is determined whether the audio output interface is connected to an unused second-category audio device; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; When the audio output interface is connected to an unused second-category audio device, connecting the first audio channel to the unused second-category audio device; When the audio output interface is not connected to an unused second-category audio device, randomly select a first device from the second-category audio devices, and determine a second switching window currently corresponding to the first device; set a third audio channel of the second switching window to a mute state, wherein the third audio channel is used to output the audio of the second switching window to the audio device corresponding to the second switching window; connect the third audio channel to the first-category audio device, and connect the first audio channel to the first device; and release the mute state of the third audio channel; The first audio channel is unmuted.

3. The display device according to claim 1, It is characterized in that After executing the step of detecting the focus window where the focus of the user control is located, the controller is further configured to: In response to a query instruction input by a user to query the audio device corresponding to the focus window, the display is controlled to display the usage status of the audio device, so that the user can switch the audio device corresponding to the focus window to a specific audio device according to the usage status of the audio device; the audio device usage status includes all audio devices that can be used by the display device and the window currently corresponding to each audio device.

4. The display device according to claim 3, It is characterized in that The user interface includes a first window and a second window; When the audio device corresponding to the first window is a first-category audio device, the audio device corresponding to the second window is a second-category audio device; When the audio device corresponding to the first window is a second-category audio device, the audio device corresponding to the second window is a first-category audio device or another second-category audio device.

5. The display device according to claim 4, It is characterized in that Before executing the step of controlling the display to display a plurality of windows, the controller is further configured to: In response to a power-on instruction input by a user indicating to start a display device, the display is controlled to display a first window, where the first window is used to play a first media resource; In executing the step of controlling the display to display a plurality of windows, the controller is further configured to: In response to the display instruction, controlling the display to simultaneously display the first window and the second window, wherein the second window is used to display a media resource recommendation list, so that the user can select a second media resource according to the media resource recommendation list; The second media resource is played in the second window.

6. The display device according to claim 4, It is characterized in that The multiple windows include a second window, and the second device is an audio device currently corresponding to the second window; When the focus window outputs audio through the second type of audio device, the controller is further configured to: In response to a switching instruction input by a user, the audio device corresponding to the focus window is switched from a first device in the second category of audio devices to a second device in the second category of audio devices, the first audio channel is connected to the second device, and the audio channel of the second window is connected to the first device.

7. The display device according to claim 1, It is characterized in that The controller is also configured to: In response to a control instruction input by a user indicating that the user interface is switched from multiple windows to a single window, the display is controlled to display only the focus window; Mute the audio channels of the remaining windows.

8. A display device, It is characterized in that include: A display, used to display a user interface, wherein the user interface includes a plurality of windows; An audio output interface, used to connect a first-category audio device and / or a second-category audio device; the first-category audio device is an audio device built into the display device, and the second-category audio device is an audio device externally connected through the audio output interface; The controller is configured as: In response to a display instruction input by a user indicating to display multiple windows, controlling the display to display the multiple windows; the multiple windows output audio through different audio devices; Detecting a focus window where a focus controlled by a user is located, wherein the focus window outputs audio through a first type of audio device; In response to a switching instruction input by a user indicating that the audio device corresponding to the focus window is switched from a first-category audio device to a specific second-category audio device, a first audio channel of the focus window is set to a mute state, and a usage state of the specific second-category audio device is determined; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; When the specific second-category audio device is in an unused state, connecting the first audio channel to the specific second-category audio device and releasing the mute state of the first audio channel; When the specific second-category audio device is in use, determine the specific switching window currently corresponding to the specific second-category audio device, and set the specific audio channel of the specific switching window to a muted state; connect the specific audio channel to the first-category audio device, and connect the first audio channel to the specific second-category audio device; release the muted state of the specific audio channel and the first audio channel; the specific audio channel is used to output the audio of the specific switching window to the audio device corresponding to the specific switching window.

9. An audio output method, applied to a display device, It is characterized in that The method comprises: In response to a display instruction input by a user indicating to display multiple windows, controlling the display to display the multiple windows; the multiple windows output audio through different audio devices; Detecting a focus window where a focus controlled by a user is located, wherein the focus window outputs audio through a second type of audio device; In response to a switching instruction input by a user indicating that the audio device corresponding to the focus window is switched from the second type of audio device to the first type of audio device, a first audio channel of the focus window is set to a mute state, and a usage state of the first type of audio device is determined; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; When the first-category audio device is not in use, connecting the first audio channel to the first-category audio device and unmuting the first audio channel; When the first-category audio device is in use, a first switching window currently corresponding to the first-category audio device is determined, and a second audio channel of the first switching window is set to a muted state; the second audio channel is connected to the second-category audio device corresponding to the focus window, and the first audio channel is connected to the first-category audio device; the muted state of the second audio channel and the first audio channel is released; the second audio channel is used to output the audio of the first switching window to the audio device corresponding to the first switching window.

10. An audio output method, applied to a display device, It is characterized in that The method comprises: In response to a display instruction input by a user indicating to display multiple windows, controlling the display to display the multiple windows; the multiple windows output audio through different audio devices; Detecting a focus window where a focus controlled by a user is located, wherein the focus window outputs audio through a first type of audio device; In response to a switching instruction input by a user indicating that the audio device corresponding to the focus window is switched from a first-category audio device to a specific second-category audio device, a first audio channel of the focus window is set to a mute state, and a usage state of the specific second-category audio device is determined; the first audio channel is used to output the audio of the focus window to the audio device corresponding to the focus window; When the specific second-category audio device is in an unused state, connecting the first audio channel to the specific second-category audio device and releasing the mute state of the first audio channel; When the specific second-category audio device is in use, determine the specific switching window currently corresponding to the specific second-category audio device, and set the specific audio channel of the specific switching window to a muted state; connect the specific audio channel to the first-category audio device, and connect the first audio channel to the specific second-category audio device; release the muted state of the specific audio channel and the first audio channel; the specific audio channel is used to output the audio of the specific switching window to the audio device corresponding to the specific switching window.