Display device and audio processing method

Abstract

The invention discloses a display device and an audio processing method, and the method comprises the steps: determining at least one audio playing device in the display device and one or more external devices in response to a starting operation of a multi-device playing mode under the condition that the display device plays a target audio, and playing the target audio through the at least one audio playing device; in response to the first volume adjustment request, performing volume adjustment on all the audio playing devices, and displaying a whole machine volume adjustment control; in response to a selection operation of a volume setting menu corresponding to any audio playing device in the setting page, displaying an external volume adjustment control corresponding to the audio playing device so as to indicate the current volume of the audio playing device; and in response to the second volume adjustment request, adjusting the volume of the audio playing device, and updating an external volume adjustment control to indicate the adjusted volume of the audio playing device. When multiple devices play audios, different audio requirements of different devices can be met.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and an audio processing method. BACKGROUND

[0002] With the rapid development of display device functions, the functions that display devices can provide for users are also becoming more and more rich. At present, display devices include smart televisions, smart set-top boxes, smart boxes, and products with smart display screens, etc. Taking a smart television as an example, when the smart television is connected to external devices, the smart television or the external devices alone usually make sounds, thereby generating a multi-device synchronous sound generation scheme. However, the multi-device synchronous sound generation scheme only supports specific scenarios and cannot achieve multi-scenario compatibility, and when the multi-devices adjust the volume, they are usually adjusted in proportion, which cannot meet the differentiated audio requirements of the multi-devices. SUMMARY

[0003] The present application provides a display device and an audio processing method, which can meet the differentiated audio requirements of different devices when multiple devices play audio.

[0004] In a first aspect, some embodiments provide a display device, comprising: a display, one or more external device interfaces, and at least one processor. The display is configured to display content from a broadcast system or a network and / or a user interface; the one or more external device interfaces are configured to communicate with one or more external devices according to a communication protocol, the communication protocol at least including a Bluetooth protocol; and the at least one processor is connected to the display and the one or more external device interfaces, and is configured to execute instructions to cause the display device to be configured to:

[0005] In the case where the display device plays target audio, in response to an opening operation of a multi-device play mode, at least one audio playing device is determined in the display device and the one or more external devices, and the target audio is played through the at least one audio playing device;

[0006] In response to a first volume adjustment request, the volume of all audio playing devices is adjusted, and a whole-machine volume adjustment control is displayed on the display; the whole-machine volume adjustment control indicates the volume of all audio playing devices after common adjustment;

[0007] In response to a selection operation of a volume setting menu corresponding to any audio playing device in the setting page, an external volume adjustment control corresponding to the audio playing device is displayed on the display; the external volume adjustment control indicates the current volume of the audio playing device; in response to a second volume adjustment request, the volume of the audio playing device is adjusted, and the external volume adjustment control is updated; the updated external volume adjustment control indicates the adjusted volume of the audio playing device.

[0008] Technical effects: Some embodiments provide a display device that communicates with one or more external devices. In a case where the display device plays target audio, in response to an opening operation of a multi-device play mode, the display device enters the multi-device play mode, determines at least one audio playing device among the display device and the external devices, and plays the target audio through the audio playing devices. Thus, in various application scenarios, the multi-device play mode can be implemented to play the target audio synchronously. In response to a first volume adjustment request, the volume of all audio playing devices is adjusted to ensure that the volume of the multi-device is adjusted synchronously. An overall volume adjustment control is displayed on the display to indicate the volume of all audio playing devices after the adjustment. In response to a selection operation of a volume setting menu corresponding to any audio playing device in a setting interface, an external volume adjustment control corresponding to the audio playing device is displayed on the display to indicate the current volume of the audio playing device. Then, in response to a second volume adjustment request, the volume of the audio playing device is adjusted to achieve individual volume adjustment of the single device. The external volume adjustment control is updated to indicate the adjusted volume of the audio playing device. The multi-device play mode can be implemented to play audio synchronously, and the different devices can meet different requirements for audio.

[0009] In a second aspect, some embodiments further provide an audio processing method applied to the display device of the first aspect. The display device includes a display, one or more external device interfaces, and at least one processor. The method includes:

[0010] In a case where the display device plays target audio, in response to an opening operation of a multi-device play mode, at least one audio playing device is determined among the display device and one or more external devices, and the target audio is played through the at least one audio playing device.

[0011] In response to a first volume adjustment request, the volume of all audio playing devices is adjusted, and an overall volume adjustment control is displayed on the display. The overall volume adjustment control indicates the volume of all audio playing devices after the adjustment.

[0012] In response to a selection operation of a volume setting menu corresponding to any audio playing device in a setting interface, an external volume adjustment control corresponding to the audio playing device is displayed on the display. The external volume adjustment control indicates the current volume of the audio playing device. In response to a second volume adjustment request, the volume of the audio playing device is adjusted, and the external volume adjustment control is updated. The updated external volume adjustment control indicates the adjusted volume of the audio playing device.

[0013] Technical effects: Some embodiments provide an audio processing method, a display device communicates with one or more external devices, in the case of playing target audio by the display device, in response to the opening operation of the multi-device playing mode, the display device enters the multi-device playing mode, at least one audio playing device is determined in the display device and each external device, and the target audio is played through each audio playing device, so that the multi-device synchronous playing of the target audio can be realized in various application scenarios; in response to a first volume adjustment request, the volume of all audio playing devices is adjusted to ensure the synchronous adjustment of the multi-device volume; the whole machine volume adjustment control is displayed in the display to indicate the volume of all audio playing devices after common adjustment; in response to the selection operation of the volume setting menu corresponding to any audio playing device in the setting interface, the external volume adjustment control corresponding to the audio playing device is displayed in the display to indicate the current volume of the audio playing device, and then, in response to a second volume adjustment request, the volume of the audio playing device is adjusted to realize the individual volume adjustment of a single device; the external volume adjustment control is updated to indicate the adjusted volume of the audio playing device. The multi-device synchronous playing of audio can be realized, and the differentiated needs of different devices for audio can be met. BRIEF DESCRIPTION OF DRAWINGS

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0015] Figure 1 The schematic diagram of the operation scene between the display device and the control device provided by some embodiments of the present application is shown.

[0016] Figure 2 The schematic diagram of the hardware configuration of the display device provided by some embodiments of the present application is shown.

[0017] Figure 3 The schematic diagram of the hardware configuration of the control device provided by some embodiments of the present application is shown.

[0018] Figure 4 The schematic diagram of the software configuration of the display device provided by some embodiments of the present application is shown.

[0019] Figure 5 The flowchart of the audio processing method provided by some embodiments of the present application is shown.

[0020] Figure 6 The schematic diagram of the sound setting page provided by some embodiments of the present application is shown.

[0021] Figure 7 A schematic diagram of a sound detail settings page provided for some embodiments of the present application;

[0022] Figure 8 A schematic diagram of a multi-mode play settings page provided for some embodiments of the present application;

[0023] Figure 9 A schematic diagram of a whole machine volume adjustment control provided for some embodiments of the present application;

[0024] Figure 10 A schematic diagram of a volume adjustment control in normal play mode provided for some embodiments of the present application;

[0025] Figure 11 A schematic diagram of a volume settings menu in a settings page provided for some embodiments of the present application;

[0026] Figure 12 A schematic diagram of an external volume adjustment control provided for some embodiments of the present application;

[0027] Figure 13 A schematic diagram of a multi-view mode provided for some embodiments of the present application;

[0028] Figure 14 A schematic diagram of a flow of dynamically adjusting a buffer provided for some embodiments of the present application;

[0029] Figure 15 A schematic diagram of a general flow of an audio processing method provided for some embodiments of the present application;

[0030] Figure 16 A schematic diagram of data interaction of an audio processing method provided for some embodiments of the present application;

[0031] Figure 17 An internal structure diagram of a computer device provided for some embodiments of the present application. DETAILED DESCRIPTION

[0032] The embodiments will be described in detail with reference to the drawings, wherein the same reference numerals refer to the same or similar elements throughout. The following detailed description is not intended to represent all embodiments in accordance with the present application. Rather, the following description is intended only to describe some embodiments in accordance with the present application, as detailed in the claims.

[0033] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0034] The terms "first", "second", "third", etc. in the specification and claims of the present application and in the above drawings are used for distinguishing between like or similar objects or entities and do not necessarily imply a specific order or sequence, unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

[0035] The terms "comprise", "comprising", "have", "having", "include", "including" and "contain", "containing", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a product or article of manufacture that comprises a list of components does not necessarily include only those components, but can include other components not expressly listed or inherent to such product or article of manufacture.

[0036] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that can perform the functions described with regard thereto.

[0037] In the embodiments of the present application, the display device 200 refers to a device with the ability of picture display and data processing. For example, the display device 200 includes, but is not limited to, a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0038] Figure 1 The schematic diagram of the operation scenario between the display device and the control device is provided for some embodiments of the present application. As shown in Figure 1 The user can operate the display device 200 through a touch operation, a mobile terminal 300 and a control device 100. For example, the control device 100 can be a remote controller, a touch pen, a handle, etc.

[0039] The mobile terminal 300 can be used as a kind of control device to perform the human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a kind of communication device to establish a communication connection with the display device 200 and perform data interaction. In some embodiments, the mobile terminal 300 can install a software application with the display device 200, realize the connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The mobile terminal 300 can also display audio and video content on the display device 200 to realize the function of synchronous display.

[0040] As shown in Figure 1 It is also shown in that the display device 200 also communicates data with the server 400 through various communication modes. The display device 200 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks.

[0041] The display device 200 can provide a broadcast receiving television function, and can additionally provide a smart network television function supporting a computer function, including but not limited to a network television, a smart television, an Internet protocol television (IPTV), and the like.

[0042] Figure 2 The display device 200 provided in some embodiments of the present application Figure 1 A hardware configuration block diagram of the display device 200 is shown in FIG. 2.

[0043] In some embodiments, the display device 200 can include at least one of a tuning demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0044] In some embodiments, the detector 230 is configured to collect signals of an external environment or an external interaction. For example, the detector 230 can include a light receiver configured to collect an ambient light intensity, or an image collector such as a camera configured to collect an external environment scene, a user attribute, or a user interaction gesture, or a sound collector such as a microphone configured to receive an external sound.

[0045] In some embodiments, the display 260 includes a display function component configured to present a picture, and a driving component configured to drive an image display. The display 260 is configured to receive an image signal output from the controller 250 and display the image signal. For example, the display 260 can be configured to display a video content, an image content, a component of a menu control interface, a user control UI interface, and the like.

[0046] In some embodiments, the communication device 220 is a component configured to communicate with an external device or a server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication manners. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0047] The communication device 220 can be configured to connect the display device 200 to the external device or the server 400 in a wireless or wired manner. The wired connection can be achieved by connecting the display device 200 to the external device through a data line, an interface, or the like. The wireless connection can be achieved by connecting the display device 200 to the external device through a wireless signal or a wireless network. The display device 200 can be directly connected to the external device, or can be indirectly connected to the external device through a gateway, a router, a connection device, or the like.

[0048] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0049] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0050] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0051] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0052] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0053] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0054] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0055] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0056] In some embodiments, as Figure 1As shown, the mobile terminal 300 or other smart electronic device, after installing the application for operating the display device 200, can play a similar function of controlling the device 100.

[0057] The controller 110 includes a processor 112 and a RAM 113 and a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, and the communication and cooperation between the internal components, as well as the external and internal data processing functions.

[0058] The communication interface 130, under the control of the controller 110, realizes the communication of control signals and data signals between the display device 200. The communication interface 130 can include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near field communication modules.

[0059] The user input / output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a key 144, and other input interfaces.

[0060] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC, etc. module, which can encode user input instructions through a WiFi protocol, or a Bluetooth protocol, or an NFC protocol, and send them to the display device 200.

[0061] The storage 190 is used to store various running programs, data and applications for driving and controlling the control device 100 under the control of the controller. The storage 190 can store various types of control signal instructions input by the user.

[0062] The power supply 180 is used to provide operating power support for the elements of the control device 100 under the control of the controller.

[0063] In order to perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program used to manage and control hardware resources and software resources in the display device 200. The operating system can provide a user interface (control the display device) to allow the user to interact with the display device 200 and support the running of various application programs.

[0064] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system based on a specific operating platform, or an independent operating system specially developed for the display device.

[0065] The operating system can be divided into different modules or levels according to the functions implemented, for example, as shown inFigure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0066] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0067] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0068] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0069] In some embodiments, the activity manager is used to manage the life cycle of each application and the general navigation back function, such as controlling the exit, opening, back, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, intercepting the screen, controlling the display window change, for example, reducing the display window, shaking the display, twisting the display, etc.

[0070] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to realize the functions of the framework layer.

[0071] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can realize functions such as hardware abstraction, multitasking, memory management, etc. For example, as shown in FIG. 1, the kernel layer can be configured with a hardware driver. The driver contained in the kernel layer can be at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power supply driver, etc. Figure 4

[0072] It should be noted that the above examples are only a simple division of the functions of the operating system, and do not constitute a limitation on the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device, the type of the operating system, and other factors, the number and specific type of the layers contained in the operating system can be in other forms.

[0073] ​With the rapid development of display device functions, the display device can provide more and more functions for users. At present, the display device includes a smart television, a smart set-top box, a smart box, and a product with a smart display screen, etc. Taking the smart television as an example, when the smart television is connected with an external device, the smart television or the external device alone usually makes a sound, thereby a multi-device synchronous sound generation scheme is generated. However, the multi-device synchronous sound generation scheme only supports a specific scene and cannot realize multi-scene compatibility. For example, in an airport broadcasting scene, when a user's earphone is connected to an airport broadcasting system, the user's earphone receives broadcasting information generated by the broadcasting system, and the user's earphone and the airport speaker synchronously play the broadcasting information. The scheme in the airport broadcasting scene cannot be compatible with other scenes, such as a home theater scene, an exhibition navigation scene, and an obstacle hearing aid scene, etc. In addition, in the traditional multi-device synchronous sound generation scheme, when the volume is adjusted, the volume ratio of the multi-device is fixed, and the multi-device will adjust the volume at the same ratio. In this way, the sound emitted in the public space as background sound will interfere with the sound emitted by the user's device, resulting in poor user experience. Therefore, the traditional method has the problem of being unable to meet the differentiated audio requirements of multi-devices when playing audio.

[0074] Based on this, the embodiments of the present application provide a display device and an audio processing method. The display device communicates with one or more external devices. In the case that the display device plays target audio, in response to an opening operation of a multi-device playing mode, the display device enters the multi-device playing mode, at least one audio playing device is determined in the display device and each external device, and the target audio is played through each audio playing device. In this way, the multi-device can synchronously play the target audio in various application scenes. In response to a first volume adjustment request, the volume of all audio playing devices is adjusted to ensure that the volume of the multi-device is synchronously adjusted. The whole machine volume adjustment control is displayed on the display to indicate the volume of all audio playing devices after common adjustment. In response to a selection operation of a volume setting menu corresponding to any audio playing device in the setting interface, the external volume adjustment control corresponding to the audio playing device is displayed on the display to indicate the current volume of the audio playing device. Then, in response to a second volume adjustment request, the volume of the audio playing device is adjusted to realize individual volume adjustment of a single device. The external volume adjustment control is updated to indicate the adjusted volume of the audio playing device. The multi-device can synchronously play audio and meet the differentiated audio requirements of different devices.

[0075] In some exemplary embodiments, as shown in Figure 5 An audio processing method is provided, which is applied to a display device 200 as an example and includes the following steps 502 to 506. Wherein:

[0076] Step 502, in the case that the display device plays target audio, in response to the opening operation of the multi-device playing mode, determining at least one audio playing device in the display device and one or more external devices, and playing the target audio through the at least one audio playing device.

[0077] The target audio refers to audio data played by the display device through a built-in speaker or an external device. The display device playing the target audio refers to playing the target audio through a built-in speaker or an external device of the display device. The target audio can have multiple sources, for example, can be sourced from a Bluetooth device, a mobile terminal or a speaker, and can also be sourced from audio in a video. For another example, the target video can also be fusion audio obtained by fusing audio of multiple sources. For example, the audio of a first source is used as background sound, and the audio of a second source is used as a main melody, and the target audio is obtained by fusing the two.

[0078] The multi-device playing mode refers to a function mode of multi-device synchronous playing provided by the display device. The setting page refers to an operation interface for configuring and personalizing various functions and parameters of the display device. For example, the setting page includes a multi-device playing mode option, and in response to a selection operation of the multi-device playing mode option, it is determined that the multi-device playing mode is opened, and the display device enters the multi-device playing mode.

[0079] As shown in Figures 6 to 8 The schematic diagram of the setting page in some embodiments is shown. Among them, Figure 6 The schematic diagram of the sound setting page is shown, Figure 7 The schematic diagram of the sound detailed setting page is shown, Figure 8 The schematic diagram of the multi-mode playing setting page is shown. In response to the opening operation of the multi-device playing mode, it includes: in response to the selection operation of the sound setting icon, the sound setting page is displayed, and the sound detailed setting option is included in the sound setting page; in response to the selection operation of the sound detailed setting option, the sound detailed setting page is displayed, and the multi-device playing setting option is included in the sound detailed setting page; in response to the selection operation of the multi-device playing setting option, the multi-device playing setting page is entered, and the multi-device playing mode option and the normal playing mode option are included in the multi-device playing setting page; in response to the selection operation of the multi-device playing mode option, it is determined that the multi-device playing mode is opened, and the display device enters the multi-device playing mode.

[0080] The external device refers to a device for playing audio data. For example, earphones, Bluetooth devices, sound bars, etc. It can be understood that the external device is a device connected to the display device. For example, the external device can be a Bluetooth device successfully paired with the display device, and can also be earphones connected to the earphone jack of the display device.

[0081] Since the display device mainly makes sound through the built-in speaker, the audio playing device is the device selected from the built-in speaker of the display device and the external devices, for playing the target audio.

[0082] In some embodiments, the number and selection of the audio playing devices can be determined according to user demand, i.e., at least one audio playing device is determined from the display device and one or more external devices according to user demand, for example, the display device and all external devices can be taken as audio playing devices, the display device and part of the external devices selected by the user can be taken as audio playing devices, part of the audio playing devices selected by the user can be taken as audio playing devices, any device selected by the user from the display device can be taken as an audio playing device, etc.

[0083] In some other embodiments, the data and selection of the audio playing devices can also be determined according to the priority of each device, i.e., the devices with priority ranking before the preset bit are taken as audio playing devices.

[0084] In some other embodiments, the devices can also be ranked according to the time of accessing the display device, i.e., the device with the latest access time is taken as the first ranking device, and the devices with access time ranking before the preset bit are taken as audio playing devices.

[0085] The target audio is played through the at least one audio playing device, including, for each audio playing device connected at the current time, playing the same frame of the target audio at the same time, and for the newly connected audio playing device, starting from the current frame, synchronizing with other connected audio playing devices to play the target audio.

[0086] In step 504, in response to the first volume adjustment request, the volume of all audio playing devices is adjusted, and the whole machine volume adjustment control is displayed in the display; the whole machine volume adjustment control indicates the volume of all audio playing devices after common adjustment.

[0087] The first volume adjustment request refers to a request for adjusting the volume of the device currently playing audio. The first volume adjustment request can be generated in various forms. For example, the first volume adjustment request is generated in response to the triggering operation of the volume button in the remote control device, or the first volume adjustment request is generated in response to the voice interaction instruction, which can be a voice instruction for adjusting the volume, or the first volume adjustment request is generated in response to the triggering operation of the volume adjustment control in the application program, etc.

[0088] Since all audio playback devices are currently playing audio, the volume of all audio playback devices is adjusted synchronously in response to the first volume adjustment request. In some embodiments, the display device and each external device have a fixed volume ratio. In response to the first volume adjustment request, all audio playback devices adjust the volume by the same ratio. For example, all audio playback devices increase the volume by 1%.

[0089] The adjusted volume refers to the volume after the volume is adjusted, and may be expressed, for example, in the form of a volume ratio.

[0090] The overall volume adjustment control refers to the control displayed on the display to indicate the adjusted volume. Figure 9 FIG. 1 is a schematic diagram of a volume adjustment control for a whole machine in some embodiments. Figure 9 As can be seen, the adjusted volume is 26. The overall volume adjustment control can include a progress bar control that intuitively displays the adjusted volume. The display can also dynamically display the numerical text corresponding to the adjusted volume and the overall volume icon.

[0091] like Figure 10 Figure 1 shows a schematic diagram of a volume adjustment control in normal playback mode in some embodiments. The volume adjustment control in normal playback mode indicates the volume of the device currently playing audio. The device currently playing audio in normal playback mode can be a built-in speaker of the display device or an external device.

[0092] Step 506: In response to a selection operation of the volume setting menu corresponding to any audio playback device in the setting page, an external volume adjustment control corresponding to the audio playback device is displayed on the display; the external volume adjustment control indicates the current volume of the audio playback device; in response to a second volume adjustment request, the volume of the audio playback device is adjusted and the external volume adjustment control is updated; the updated external volume adjustment control indicates the adjusted volume of the audio playback device.

[0093] In order to achieve individual volume adjustment for each audio playback device to meet the differentiated needs of different devices, the embodiment of the present application proposes to add a volume setting menu corresponding to each audio playback device in the setting page. When the volume setting menu corresponding to any audio playback device is selected, the volume of only the audio playback device can be adjusted. Figure 11 FIG2 is a schematic diagram of a volume setting menu in a setting page in some embodiments. For example, in response to a triggering operation of a setting button, a setting page is displayed on the display, and the setting page includes at least a volume setting menu corresponding to each audio playback device, referring to FIG2. Figure 11 , and then select the Headphone Volume menu in the .

[0094] The external volume adjustment control refers to a control displayed in the display, which is used to indicate the current volume and the adjusted volume. As shown in Figure 12 Fig. 1 shows a schematic diagram of the external volume adjustment control in some embodiments. As shown in Figure 12 It can be known that the current volume or the adjusted volume of the audio playing device is 26. In response to the selection operation of any volume setting menu, the external volume adjustment control corresponding to the audio playing device is displayed in the display, at this time, the external volume adjustment control indicates the current volume of the audio playing device, and then, in response to the second volume adjustment request, the audio playing device can be adjusted in volume individually, and at the same time, the external volume adjustment control in the display is updated, at this time, the external volume adjustment control indicates the adjusted volume of the audio playing device. In some embodiments, the volume icon of the audio playing device is also displayed in the display to indicate the type of the device for which the volume is adjusted. As shown in Figure 12 It can be known that the current volume adjustment is for the earphone.

[0095] In the above audio processing method, the display device communicates with one or more external devices, in the case that the display device plays target audio, in response to the opening operation of the multi-device playing mode, the display device enters the multi-device playing mode, at least one audio playing device is determined in the display device and each external device, and the target audio is played through each audio playing device, so that the multi-device synchronous playing of the target audio can be realized in various application scenarios; in response to the first volume adjustment request, the volume of all audio playing devices is adjusted to ensure the multi-device volume synchronous adjustment; the whole machine volume adjustment control is displayed in the display to indicate the volume after the common adjustment of all audio playing devices; in response to the selection operation of the volume setting menu corresponding to any audio playing device in the setting interface, the external volume adjustment control corresponding to the audio playing device is displayed in the display to indicate the current volume of the audio playing device, and then, in response to the second volume adjustment request, the volume of the audio playing device is adjusted to realize the individual volume adjustment of the single device; the external volume adjustment control is updated to indicate the adjusted volume of the audio playing device. The multi-device synchronous playing of the audio can be realized, and the differentiated needs of different devices for the audio can be met.

[0096] In some example embodiments, determining at least one audio playing device from the display device and the one or more external devices and playing the target audio through the at least one audio playing device includes: in a case where the display device is in a single-view mode, determining at least one target audio playing device from the display device and the one or more external devices and playing the target audio through the at least one target audio playing device; in a case where the display device is in a multi-view mode, determining at least a first audio playing device and a second audio playing device from the display device and the one or more external devices, playing audio corresponding to the first view area through the first audio playing device, and playing audio corresponding to the second view area through the second audio playing device; and the target audio includes any one of the audio corresponding to the first view area and the audio corresponding to the second view area.

[0097] The single-view mode refers to a mode in which a display displays a view of a single application, and in the single-view mode, the display includes a single view area. For example, the single view area displays a video under an A application, and the target audio can be audio in the video under the A application. The target audio playing device is an audio playing device determined from the display device and the external devices, and is used to play the target audio. The target audio playing device can be determined according to user demand, priority of the devices, or access time sequence of the devices.

[0098] The multi-view mode refers to a mode in which a display displays views of multiple applications in parallel, and in the multi-view mode, the display includes at least a first view area and a second view area. For example, the first view area displays a video under an A application, and the second view area displays a video under a B application. The target audio includes any one of audio corresponding to the video in the first view area and audio corresponding to the video in the second view area. Figure 13 FIG. 2 shows a schematic diagram of the multi-view mode in some embodiments. For example, the first view area displays a video under an A application, the second view area displays a video under a B application, and the target audio includes any one of audio corresponding to the video in the first view area and audio corresponding to the video in the second view area. In order to realize that the audio corresponding to each view area can sound at the same time and do not interfere with each other, embodiments of the present application propose determining at least a first audio playing device and a second audio playing device from the display device and the one or more external devices, so that the audio corresponding to the first view area can be played through the first audio playing device, and the audio corresponding to the second view area can be played through the second audio playing device.

[0099] In some embodiments, when more than two view areas are included in the display, the same way can be used to play the audio corresponding to each view area through different audio playing devices.

[0100] In the embodiment, different strategies are adopted to determine the audio playing devices in the single-view mode and the multi-view mode, so that in the single-view mode, at least one audio playing device synchronously plays the target video, for example, audio playing devices in different positions or audio playing devices of different types can synchronously play the target video, and the playing demand of the multiple audio playing devices for the target video is met; in the multi-view mode, each audio playing device can play audio corresponding to a different view area, so that users interested in different view areas can hear the audio corresponding to the corresponding view area, and the user experience is improved.

[0101] In some exemplary embodiments, the at least one target audio playing device is determined in the display device and the one or more external devices, including: taking the display device and the one or more external devices as the target audio playing devices; or, displaying the playing controls of the display device and the one or more external devices in the display, and taking the device corresponding to the selected playing control as the target audio playing device in response to the selection operation of any one or more playing controls.

[0102] In the embodiment, the display device and the one or more external devices are taken as the target audio playing devices, so that the display device and the external devices connected to the display device can synchronously emit sound.

[0103] The processor can also determine the target audio playing device based on the selection of the user, so as to improve the user experience. Specifically, the playing controls of the display device and the external devices are displayed in the display, and the device corresponding to the selected playing control is taken as the target audio playing device in response to the selection operation of any one or more playing controls, so that the user can select the target audio playing device expected to be played.

[0104] In some embodiments, the display device and the external devices can also be grouped, and for each group of devices, the target audio playing device corresponding to each group of devices is determined in response to the selection operation of any one device in each group of devices.

[0105] In the embodiment, the display device and the external devices are taken as the target audio playing devices, or the target audio playing device is determined based on the selection of the user, so that the selection flexibility of the target audio playing device is improved, and the differentiated demand of the user for the audio is met, and the user experience is improved.

[0106] In some exemplary embodiments, the first audio playing device and the second audio playing device are determined from the display device and the one or more external devices, including: displaying the respective playing controls of the display device and the one or more external devices in the surrounding area of the first view area, and displaying the respective playing controls of the display device and the one or more external devices in the surrounding area of the second view area; in response to a selection operation on any one or more of the respective playing controls of the first view area, taking the device corresponding to the selected playing control as the first audio playing device; taking the playing controls of the second view area that have been selected as unselectable; and in response to a selection operation on any one or more of the selectable playing controls of the second view area, taking the device corresponding to the selected playing control as the second audio playing device.

[0107] In the method for determining the audio playing device in the multi-view scene, the corresponding audio playing device can be determined for each view area. For reference Figure 13 The respective playing controls of the display device and the one or more external devices are displayed in the surrounding area of each view area, and in response to a selection operation on any one or more of the respective playing controls of the first view area, the device corresponding to the selected playing control is taken as the first audio playing device. Since the device corresponding to the selected playing control is used to play audio, to avoid audio playing interference, the playing controls of the second view area that have been selected are taken as unselectable, and the remaining playing controls are taken as the selectable playing controls in the second view area, and in response to a selection operation on any one or more of the selectable playing controls of the second view area, the device corresponding to the selected playing control is taken as the second audio playing device.

[0108] In some embodiments, the display device and the specified devices of the one or more external devices can also be taken as the first audio device, and the other devices are taken as the second audio device. For example, the sound wall and the display device are taken as the first audio device, and the earphone and the Bluetooth device are taken as the second audio device. The display device and the specified devices of the one or more external devices can also be taken as the first audio device, and the other devices are taken as the second audio device; in response to a selection operation on any one or more of the playing controls corresponding to the first audio device, the device corresponding to the selected playing control is taken as the first audio playing device; and in response to a selection operation on any one or more of the playing controls corresponding to the second audio device, the device corresponding to the selected playing control is taken as the second audio playing device.

[0109] In the embodiment, in the multi-view mode, a first audio playing device corresponding to a first view area is determined through user selection, and a second audio playing device corresponding to a second view area is determined from the remaining devices through user selection. In this way, the audio corresponding to different view areas is played by different devices, meeting the differentiated needs of the user for the audio and improving the user experience.

[0110] In some example embodiments, playing the target audio through the at least one audio playing device includes: obtaining device positions of the at least one audio playing device respectively; determining sound wave transmission delays according to the device positions, dynamically adjusting lengths of audio buffer areas of corresponding output channels based on the sound wave transmission delays; adjusting the corresponding audio buffer areas based on the lengths of the audio buffer areas, and distributing the target audio to the adjusted audio buffer areas, so as to play the target audio through the audio output devices.

[0111] The device position indicates the position of the audio playing device in space, and the distance between the corresponding audio playing device and the display device can be determined based on the device position. In an actual scenario, an external device based on wireless signal communication can move within a certain position range from the display device and maintain a connection relationship with the display device. However, in a multi-device playing scenario, the movement of the device position can cause a device playing delay problem. Based on this, the device positions of the audio playing devices are obtained in the embodiments of the present application to compensate for the audio playing delay problem. In this way, the device positions of the audio playing devices based on wireless signal communication can be mainly obtained.

[0112] In some embodiments, the device positions can be obtained based on images of the user and the audio playing device obtained through a camera.

[0113] The sound wave transmission delay refers to the delay of the transmission of the audio signal to the audio playing devices. The sound wave transmission delay can be calculated based on the device positions. For example, the distances between the audio playing devices and the display device can be calculated based on the device positions, and the distances are divided by the transmission speed of the signal to obtain the sound wave transmission delay. The sound wave transmission delay can be expressed by the following formula: t prop = d i / v x 1000, where t prop represents the sound wave transmission delay, d i represents the distance between the audio playing device i and the display device, and v represents the transmission speed of the signal.

[0114] In some embodiments, the device positions can also be subjected to Kalman filtering to obtain filtered device positions, and the sound wave transmission delays can be determined based on the filtered device positions.

[0115] The target audio is output to each audio playing device through multiple output channels respectively, each audio playing device corresponds to an independent audio buffer, and the processor can distribute the target audio data to each audio buffer through multi-thread parallel processing technology to realize simultaneous playing of multiple devices. For example, Av-syncSpeakerBuffer0 is an audio buffer corresponding to a speaker (Speaker), Av-syncHeaderBuffer1Phone is an audio buffer corresponding to a headset or a mobile terminal, and Av-syncBTBuffer2 is an audio buffer corresponding to a Bluetooth device (BT).

[0116] Since the audio playing devices at different positions receive the same audio data at different times, the target audio played by each device is out of sync, therefore, the processor adjusts the length of the audio buffer of the corresponding output channel according to the sound wave transmission delay, so that each device plays the same audio frame at the same time, realizing audio synchronization, thereby compensating for the sound delay caused by the design position difference.

[0117] Adjusting the audio buffer of each channel according to the length of the audio buffer, for example, the audio buffer can be dynamically adjusted by inserting silence data and adjusting the pointer offset. Distributing the target audio to each adjusted audio buffer to play the target audio through each audio output device can realize synchronized playing of the target audio by each audio output device.

[0118] In this embodiment, the sound wave transmission delay is calculated according to the position of the audio playing device, and the length of the audio buffer is dynamically adjusted according to the sound wave transmission delay, which is beneficial to solve the sound delay problem of playing the target audio by devices at different positions at the same time, ensure that multiple devices play the same audio, and improve the user's experience.

[0119] In some exemplary embodiments, dynamically adjusting the length of the audio buffer of the corresponding output channel based on the sound wave transmission delay includes: adding the sound wave transmission delay to the inherent delay of the corresponding device to obtain a composite delay; determining a reference delay according to the respective composite delays of the at least one audio playing device, and determining a compensation value for each audio playing device according to the reference delay; and adjusting the length of the audio buffer of the corresponding output channel according to the respective compensation values of the audio playing devices.

[0120] The inherent delay refers to the delay caused by the hardware or software of each device itself, which can be obtained through system calibration. For each audio playing device, the sound wave transmission delay is added to the inherent delay of the device to obtain a composite delay. The calculation formula of the composite delay can be expressed as: t_total=t_prop+t_hardware. Wherein, t_total represents the composite delay, and t_hardware represents the inherent delay.

[0121] The synthesis delay of each audio playing device can be different, and thus the base delay can be determined according to the synthesis delay of each audio playing device, so as to adjust the audio buffer length according to the base delay. Exemplarily, the maximum synthesis delay among the synthesis delays of the audio playing devices can be taken as the base delay, and the mean, median, mode, or weighted value of the synthesis delays can also be taken as the base delay.

[0122] The method for determining the compensation value of each device based on the base delay can be subtracting the synthesis delay of each audio playing device from the base delay, and taking the result as the compensation value of each audio playing device. The calculation formula of the compensation value can be expressed as: Δt_i=t_base-t_total_i. Wherein, Δt_i represents the compensation value corresponding to the audio playing device i, t_base represents the base delay, and t_total_i represents the synthesis delay corresponding to the audio playing device i.

[0123] The method for dynamically adjusting the audio buffer length based on the compensation value can be querying the mapping relationship pre-calibrated, and querying the audio buffer length corresponding to each compensation value.

[0124] As Figure 14 The flowchart of dynamically adjusting the buffer in some embodiments is shown. The device pre-calibration can be performed in the system initialization process, including the inherent delay calibration, and the device coordinate calibration can also be performed. The user image is collected in real time to detect the device position, the device position is filtered, the sound wave transmission delay is calculated based on the filtered device position, the synthesis delay is determined in combination with the inherent delay, the base delay is determined, the compensation value is calculated based on the base delay, the audio buffer is dynamically adjusted based on the compensation value, and the target audio is synchronously played by the multiple devices.

[0125] In this embodiment, the base delay is determined according to the synthesis delay of each device by adding the sound wave transmission delay and the inherent delay of the device, so as to determine the compensation value of each device, and the audio buffer length of the corresponding output channel is dynamically adjusted according to the compensation value, which is beneficial to solve the sound delay problem of the devices at different positions playing the target audio at the same time, ensures that the multiple devices play the same audio, and improves the user experience.

[0126] In some example embodiments, the audio processing method further comprises: in the case that the display device plays the target audio and an access signal of any external device is received, taking the external device, the display device and other accessed external devices as audio playing devices, and playing the target audio through the audio playing devices; or in the case that the display device plays the target audio and an access signal of any external device is received, taking the external device and other accessed external devices as private audio playing devices, and playing preset private audio through the private audio playing devices; or in the case that the display device plays the target audio and an access signal of any hearing aid device is received, performing audio enhancement processing on the target audio, and playing the audio after the enhancement processing through the hearing aid device.

[0127] The audio processing method can be applied to various application scenarios, and some data processing processes can be added to adapt to specific application scenarios for different application scenarios.

[0128] For example, in the case of newly accessing an external device, the newly accessed external device, other accessed external devices and the display device can all be taken as audio playing devices to play the target audio through the audio playing devices. For example, the method can be applied to public scenarios such as airport broadcasting, and the external device can be a user's earphone, which can ensure that each newly accessed external device, accessed external device and display device synchronously play the target audio. In some embodiments, the target audio output to the external device can be processed, such as noise reduction, to ensure that the user receives clear audio data.

[0129] For example, in the case of newly accessing an external device, the newly accessed external device, other accessed external devices and the display device can all be taken as audio playing devices to play the target audio through the audio playing devices. For example, the method can be applied to public scenarios such as airport broadcasting, and the external device can be a user's earphone, which can ensure that each newly accessed external device, accessed external device and display device synchronously play the target audio. In some embodiments, the target audio output to the external device can be processed, such as noise reduction, to ensure that the user receives clear audio data.

[0130] For example, in the case of newly accessing an external device, the newly accessed external device, other accessed external devices and the display device can all be taken as audio playing devices to play the target audio through the audio playing devices. For example, the method can be applied to public scenarios such as airport broadcasting, and the external device can be a user's earphone, which can ensure that each newly accessed external device, accessed external device and display device synchronously play the target audio. In some embodiments, the target audio output to the external device can be processed, such as noise reduction, to ensure that the user receives clear audio data.

[0131] In this embodiment, some audio processing methods suitable for specific application scenarios can be added according to specific application scenarios to ensure that the audio processing method meets the differentiated needs of users in specific scenarios.

[0132] In some example embodiments, the audio processing method further comprises: in response to a volume adjustment request of any external device, adjusting the volume of the external device.

[0133] Among the external devices, each can have a volume adjustment function, for example, in the form of a button, a touch screen control, voice, etc. In response to a volume adjustment request from any external device, the external device is individually adjusted in volume.

[0134] In this embodiment, each external device can individually initiate a volume adjustment request, and the processor individually processes the volume adjustment request from each external device, identifies the external device corresponding to the volume adjustment request, and thus individually adjusts the volume of the external device, meeting the user's volume adjustment needs for different devices.

[0135] To explain the display device and the audio processing method and the effects in this solution in detail, a most detailed embodiment is described below:

[0136] The display device includes a display, one or more external device interfaces, and at least one processor. The display is configured to display content from a broadcast system or a network and / or a user interface. The one or more external device interfaces are used to communicate with one or more external devices according to a communication protocol, which at least includes a Bluetooth protocol. The at least one processor is connected to the display and the one or more external device interfaces, and is configured to execute instructions to perform an audio processing method.

[0137] As Figure 15 The overall flowchart of the audio processing method in some embodiments is shown. For multiple sources of audio sources (for example, from Bluetooth devices, mobile terminals, speakers, etc.), a multi-decoder structure can be used, including at least a master decoder and a slave decoder, to decode and process multiple audio sources through the multi-decoder structure, mix or separately process the multiple decoded audio sources through a mixing module, and then distribute the processed audio to different output channel audio buffers through an audio quality module for sound effect processing, and then through the external devices connected to each output channel to synchronously play the audio. The mixing module is used to independently adjust the gain of the volume of different output channels. For example, the volume of the Bluetooth device is reduced by 50%, and the volume of the speaker is increased by 30%. It is also used for hierarchical control: supporting global volume (master control) and single device volume (subordinate control) superimposed adjustment. The master / slave decoder can support decoding processing of multiple format audio sources, such as MP3, AAC format, etc. In some embodiments, the master decoder is used to process high-priority audio (such as playing a DTV signal), and the slave decoder is used to process background audio (such as music). The audio quality module is used to manage multi-device sound effects, configure optimal sound effect parameters, and achieve optimal experience.

[0138] As Figure 16Fig. 1 shows a schematic diagram of data interaction of an audio processing method in some embodiments. In the case that a display device plays target audio, in response to an opening operation of a multi-device playing mode, at least one audio playing device is determined in the display device and one or more external devices, and the target audio is played through the at least one audio playing device. For example, in response to a selection operation of a playing control of the display device and external devices 1, 2, and 3, the display device, external devices 1, 2, and 3 are taken as audio playing devices, the target audio is sent to the audio buffer corresponding to each audio playing device, and the target audio is played through each audio playing device. In response to a first volume adjustment request, the volume of the display device, external devices 1-3 is adjusted, and a whole-machine volume adjustment control is displayed on the display; the whole-machine volume adjustment control indicates the volume after the adjustment of all audio playing devices together. In response to a selection operation of a volume setting menu corresponding to any audio playing device (for example, external device 1) in a setting page, an external volume adjustment control corresponding to external device 1 is displayed on the display; the external volume adjustment control indicates the current volume of external device 1. In response to a second volume adjustment request, the volume of external device 1 is adjusted, and the external volume adjustment control is updated; the updated external volume adjustment control indicates the adjusted volume of external device 1.

[0139] In some embodiments, the display device is in a single-view mode, and the display device and one or more external devices can be taken as target audio playing devices; or, the playing controls of the display device and one or more external devices are displayed on the display, and in response to a selection operation of any one or more playing controls, the device corresponding to the selected playing control is taken as a target audio playing device, and the target audio is played through the at least one target audio playing device.

[0140] In some embodiments, the display device is in a multi-view mode, and at least a first audio playing device and a second audio playing device can be determined in the display device and one or more external devices, and the audio corresponding to the first view area is played through the first audio playing device, and the audio corresponding to the second view area is played through the second audio playing device; the target audio includes any one of the audio corresponding to the first view area and the audio corresponding to the second view area.

[0141] In the display device and the one or more external devices, at least the first audio playing device and the second audio playing device are determined, including: displaying the playing controls of the display device and the one or more external devices in the surrounding area of the first view area, and displaying the playing controls of the display device and the one or more external devices in the surrounding area of the second view area; in response to a selection operation of any one or more of the playing controls corresponding to the first view area, taking the device corresponding to the selected playing control as the first audio playing device; taking the playing controls corresponding to the second view area as unselectable; in response to a selection operation of any one or more of the selectable playing controls corresponding to the second view area, taking the device corresponding to the selected playing control as the second audio playing device.

[0142] In some embodiments, playing the target audio through the at least one audio playing device includes: obtaining the device positions of the at least one audio playing device; determining the sound wave transmission delay according to the device positions; dynamically adjusting the audio buffer length of the corresponding output channel based on the sound wave transmission delay; adjusting the corresponding audio buffer based on the audio buffer length, and distributing the target audio to the adjusted audio buffers, so as to play the target audio through the audio output devices.

[0143] In some embodiments, dynamically adjusting the audio buffer length of the corresponding output channel based on the sound wave transmission delay includes: adding the sound wave transmission delay and the inherent delay of the corresponding device to obtain a composite delay; determining the reference delay according to the composite delay of the at least one audio playing device, and determining the compensation value of each audio playing device according to the reference delay; and adjusting the audio buffer length of the corresponding output channel according to the compensation value of each audio playing device.

[0144] In some embodiments, the audio processing method further includes: in the case that the display device plays the target audio and an access signal of any external device is received, taking the external device, the display device and other accessed external devices as audio playing devices, and playing the target audio through the audio playing devices; or in the case that the display device plays the target audio and an access signal of any external device is received, taking the external device and other accessed external devices as private audio playing devices, and playing the preset private audio through the private audio playing devices; or in the case that the display device plays the target audio and an access signal of any hearing aid device is received, performing audio enhancement processing on the target audio, and playing the audio after the enhancement processing through the hearing aid device.

[0145] In some embodiments, the audio processing method further includes: in response to a volume adjustment request of any external device, adjusting the volume of the external device.

[0146] Some embodiments provide a display device and an audio processing method. The display device communicates with one or more external devices. When the display device plays target audio, the display device enters a multi-device playing mode in response to an opening operation of the multi-device playing mode. At least one audio playing device is determined in the display device and the external devices. The target audio is played by the audio playing devices. Thus, the multi-device synchronous playing of the target audio can be realized in various application scenarios. In response to a first volume adjustment request, the volume of all the audio playing devices is adjusted to ensure the synchronous adjustment of the multi-device volume. An overall volume adjustment control is displayed on the display to indicate the volume of all the audio playing devices after the common adjustment. In response to a selection operation of a volume setting menu corresponding to any audio playing device in a setting interface, an external volume adjustment control corresponding to the audio playing device is displayed on the display to indicate the current volume of the audio playing device. Then, in response to a second volume adjustment request, the volume of the audio playing device is adjusted to realize the individual volume adjustment of the single device. The external volume adjustment control is updated to indicate the adjusted volume of the audio playing device. The multi-device synchronous playing of the audio can be realized, and the differentiated needs of different devices for the audio can be met.

[0147] It should be understood that, although each step in the flowchart involved in each embodiment as described above is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times. The execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0148] In an exemplary embodiment, a computer device, which can be a terminal, is provided. The internal structure diagram of the computer device can be as follows Figure 17The computer device shown in the figure includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be realized through WIFI, mobile cellular network, near field communication (NFC) or other technologies. The computer program is executed by the processor to realize an audio processing method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0149] Those skilled in the art can understand that, Figure 17 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0150] In one exemplary embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps in each of the method embodiments described above.

[0151] In one embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the steps in each of the method embodiments described above.

[0152] In one embodiment, a computer program product is provided, including a computer program, and the computer program is executed by a processor to implement the steps in each of the method embodiments described above.

[0153] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0154] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing related hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium. When the computer program is executed, it can include the processes of the above-mentioned embodiments of each method. In the embodiments provided in the present application, any reference to memory, database or other medium can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (Resistive Random Access Memory, ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (Artificial Intelligence, AI) processor, etc., without being limited thereto.

[0155] Any technical features in the above embodiments can be combined, and for the sake of brevity, not all possible combinations are described above, however, any combination of these technical features is deemed to be within the scope of the present application.

[0156] The above embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the patent scope of the present application. It should be pointed out that, for ordinary skilled persons in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A display device, characterized in that: include: a display configured to display content from a broadcast system or network and / or a user interface; One or more external device interfaces, configured to communicate with one or more external devices according to a communication protocol, the communication protocol including at least a Bluetooth protocol; and at least one processor connected to the display and the one or more external devices and configured to execute instructions to cause the display device to be configured to: In a case where the display device plays the target audio, in response to an operation of starting a multi-device playback mode, determining at least one audio playback device from the display device and one or more external devices, and playing the target audio through the at least one audio playback device; In response to the first volume adjustment request, adjusting the volume of all audio playback devices and displaying a whole-device volume adjustment control on the display; the whole-device volume adjustment control indicates the volume of all audio playback devices after being adjusted together; In response to a selection operation of a volume setting menu corresponding to any audio playback device in a setting page, an external volume adjustment control corresponding to the audio playback device is displayed on the display; the external volume adjustment control indicates the current volume of the audio playback device; in response to a second volume adjustment request, the volume of the audio playback device is adjusted and the external volume adjustment control is updated; the updated external volume adjustment control indicates the adjusted volume of the audio playback device.

2. The display device according to claim 1, wherein The processor is configured to: determine at least one audio playback device from the display device and one or more external devices, and play the target audio through the at least one audio playback device; When the display device is in a single-view mode, determining at least one target audio playback device among the display device and one or more external devices, and playing the target audio through the at least one target audio playback device; When the display device is in multi-view mode, at least a first audio playback device and a second audio playback device are determined in the display device and one or more external devices, and audio corresponding to a first view area is played through the first audio playback device, and audio corresponding to a second view area is played through the second audio playback device; the target audio includes any one of the audio corresponding to the first view area and the audio corresponding to the second view area.

3. The display device according to claim 2, wherein The processor determines at least one target audio playback device among the display device and one or more external devices, including: The display device and one or more external devices are all used as target audio playback devices; or, The display device and respective playback controls of one or more external devices are displayed on the display, and in response to a selection operation of any one or more playback controls, the device corresponding to the selected playback control is used as a target audio playback device.

4. The display device according to claim 2, wherein: The processor is configured to: determine at least a first audio playback device and a second audio playback device from the display device and one or more external devices; Displaying playback controls of the display device and the one or more external devices in a surrounding area of ​​the first viewing area, and displaying playback controls of the display device and the one or more external devices in a surrounding area of ​​the second viewing area; In response to a selection operation of any one or more of the playback controls corresponding to the first viewing area, using a device corresponding to the selected playback control as a first audio playback device; Setting the selected playback controls among the playback controls corresponding to the second viewing area to be unselectable; In response to a selection operation of any one or more of the selectable playback controls corresponding to the second viewing area, a device corresponding to the selected playback control is used as a second audio playback device.

5. The display device according to claim 1, wherein The processor executes playing the target audio through at least one audio playback device, and is configured to: Obtaining the device location of at least one audio playback device; determining a sound wave transmission delay according to the device position, and dynamically adjusting an audio buffer length of a corresponding output channel based on the sound wave transmission delay; The corresponding audio buffer is adjusted based on the audio buffer length, and the target audio is distributed to each adjusted audio buffer so as to play the target audio through each audio output device.

6. The display device according to claim 5, wherein: The processor dynamically adjusts the audio buffer length of the corresponding output channel based on the sound wave transmission delay, and is configured to: Adding the acoustic wave transmission delay to the intrinsic delay of the corresponding device to obtain a composite delay; Determining a reference delay based on the composite delay of at least one audio playback device, and determining a compensation value for each audio playback device based on the reference delay; The audio buffer length of the corresponding output channel is adjusted according to the compensation value of each audio playback device.

7. The display device according to claim 1, wherein The processor is further configured to: When the display device plays the target audio and receives an access signal from any external device, the external device, the display device, and other connected external devices are used as audio playback devices, and the target audio is played through the audio playback device; Alternatively, when the display device plays the target audio and receives an access signal from any external device, the external device and other connected external devices are used as private audio playback devices, and the preset private audio is played through the private audio playback device; Alternatively, when the display device plays the target audio and receives an access signal from any hearing aid device, the target audio is enhanced, and the enhanced audio is played through the hearing aid device.

8. The display device according to claim 1, wherein The processor is further configured to: In response to a volume adjustment request from any external device, the volume of the external device is adjusted.

9. An audio processing method, characterized in that: include: In a case where the display device plays the target audio, in response to an operation of starting a multi-device playback mode, determining at least one audio playback device from the display device and one or more external devices, and playing the target audio through the at least one audio playback device; In response to the first volume adjustment request, adjusting the volume of all audio playback devices and displaying a whole-device volume adjustment control on the display; the whole-device volume adjustment control indicates the volume of all audio playback devices after being adjusted together; In response to a selection operation of a volume setting menu corresponding to any audio playback device in a setting page, an external volume adjustment control corresponding to the audio playback device is displayed on the display; the external volume adjustment control indicates the current volume of the audio playback device; in response to a second volume adjustment request, the volume of the audio playback device is adjusted and the external volume adjustment control is updated; the updated external volume adjustment control indicates the adjusted volume of the audio playback device.

10. The method according to claim 9, characterized in that The determining at least one audio playback device among the display device and the one or more external devices, and playing the target audio through the at least one audio playback device, includes: When the display device is in a single-view mode, determining at least one target audio playback device among the display device and one or more external devices, and playing the target audio through the at least one target audio playback device; When the display device is in multi-view mode, at least a first audio playback device and a second audio playback device are determined in the display device and one or more external devices, and audio corresponding to a first view area is played through the first audio playback device, and audio corresponding to a second view area is played through the second audio playback device; the target audio includes any one of the audio corresponding to the first view area and the audio corresponding to the second view area.

Images