A display device and an audio processing method

Abstract

The present application discloses a display device and an audio processing method, which receives an access signal sent by an external device that has been connected, and determines that the external device that has been connected supports the first sound effect processing when the access signal contains a first identifier that supports the first sound effect processing; determines that the external device that has been connected does not support the first sound effect processing when the access signal does not contain the first identifier that supports the first sound effect processing; and parses the audio file into pulse code modulation data when the external device that has been connected does not support the first sound effect processing and the first sound effect has been turned on, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device to instruct the external device to play audio based on the processed pulse code modulation data. The use of this method can greatly enhance the spatial sound field effect of the output.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and an audio processing method. Background Art

[0002] With the rapid development of display device functions, the functions that display devices can provide to users are becoming more and more abundant. At present, display devices include smart TVs, smart set-top boxes, smart boxes, and products with smart display screens. Taking smart TVs as an example, in order to improve the output sound effect of smart TVs, soundbars can be connected to smart TVs to output specific sound field effects.

[0003] However, after the smart TV is connected to a sound bar device, the built-in sound effects of the smart TV have been unavailable. The sound field effect output by the smart TV depends on the hardware configuration of the connected sound bar device, which cannot meet the user's demand for high-quality sound field effects. Therefore, traditional display devices have the problem of poor output sound effects. Summary of the invention

[0004] The present application provides a display device and an audio processing method to solve the problem of poor output sound quality of traditional display devices.

[0005] In a first aspect, some embodiments provide a display device, comprising: a display, one or more external device interfaces, and at least one processor. The display is configured to display content from a broadcast system or network and / or a user interface; the one or more external device interfaces are used to communicate with one or more external devices according to a communication protocol, wherein the communication protocol includes at least a Bluetooth protocol; and at least one processor is connected to the display and the one or more external device interfaces and is configured to execute instructions so that the display device is configured to:

[0006] Receiving an access signal sent by an external device that has been connected, and determining that the external device that has been connected supports the first sound effect processing if the access signal includes a first identifier that supports the first sound effect processing; and determining that the external device that has been connected does not support the first sound effect processing if the access signal does not include the first identifier that supports the first sound effect processing;

[0007] When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the audio file is parsed into pulse code modulation data, the pulse code modulation data is at least processed with the first sound effect, and the processed pulse code modulation data is sent to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

[0008] Technical effect: According to whether the access signal sent by the connected external device contains the first identifier of supporting the first sound effect processing, it is helpful to determine whether the connected external device supports the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local device parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method of performing the first sound effect processing on the local device and playing audio by the external device can greatly enhance the output spatial sound field effect compared to the external device playing audio based on pulse code modulation data that has not been processed by the first sound effect.

[0009] In some embodiments, the processor performs at least a first sound effect processing on the pulse code modulation data, and is configured to:

[0010] In the case where the connected external device does not support the first sound effect processing and the first sound effect is turned on, in response to the triggering operation of the sound setting entry, a sound setting page is displayed; the sound setting page contains at least the first sound effect setting item and is triggerable;

[0011] In response to the setting operation for the first sound effect setting item, a sound effect setting result is obtained, and the pulse code modulation data is subjected to first sound effect processing according to the sound effect setting result to obtain processed pulse code modulation data.

[0012] Technical effect: The first sound effect setting item is triggerable. When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the triggerable first sound effect setting item is displayed in response to the trigger operation of the sound setting entrance. In this way, the user can set the first sound effect setting item according to his or her own needs, which improves the diversity of the sound effect setting results. The first sound effect processing is performed on the pulse code modulation data based on the sound effect setting results, which is beneficial to improving the spatial sound field effect of the output sound.

[0013] In some embodiments, the sound setting page further includes a sound mode setting item and is triggerable, and the sound mode is used to determine the sound channel used by the external device; the processor executes the setting operation in response to the first sound effect setting item to obtain the sound effect setting result, and is configured to:

[0014] In response to a setting operation on at least one of the first sound effect setting item or the sound mode setting item, a sound effect setting result is acquired.

[0015] Technical effect: The sound setting page also includes a triggerable sound mode setting item, so that the user can set at least one of the first sound effect setting item or the sound mode setting item according to their own needs, further improving the diversity of the sound effect setting results. Audio processing based on the sound effect setting results is conducive to improving the spatial sound field effect of the output sound.

[0016] In some embodiments, the processor is further configured to:

[0017] When the connected external device does not support the first sound effect processing and the external device is connected for the first time, a first prompt screen is displayed, wherein the first prompt screen is used to prompt that the first sound effect can be turned on to allow the local device to perform the first sound effect processing.

[0018] Technical effect: When an external device that does not support the first sound effect processing is connected for the first time, the user can be prompted to turn on the first sound effect by displaying the first prompt screen, so as to experience the sound effect of the first sound effect processed by the local device, which is conducive to improving the user experience.

[0019] In some embodiments, the processor is further configured to:

[0020] If the connected external device supports the first sound effect processing and the joint sound generation is turned on, parsing the audio file into pulse code modulation data, performing sound effect processing on the pulse code modulation data of at least part of the channels, and sending the pulse code modulation data of at least part of the channels to the external device, so that the external device performs the sound effect processing;

[0021] Based on the processed pulse code modulation data of at least part of the channels, joint audio playback is performed with the external device.

[0022] Technical effect: For external devices that support the first sound effect processing, by turning on joint sound, the local machine parses the audio file into pulse code modulation data, performs sound effect processing on the pulse code modulation data of at least part of the channels, and the external device performs sound effect processing on the pulse code modulation data of at least part of the channels, and the two perform joint audio playback to achieve joint sound. Since the sound effect functions supported by the local machine and the external device may be different, the method of joint sounding by splitting the channels can combine the sound effect capability advantages of the two and greatly enhance the spatial sound field effect of the output sound.

[0023] In some embodiments, the sound channels of the local device and the external device that need to be processed by sound effects are determined by a sound mode; the processor performs the sound mode determination process and is configured to:

[0024] In response to the triggering operation of the sound setting portal, a sound setting page is displayed, in which a sound mode setting item exists and is triggerable;

[0025] In response to a setting operation for the sound mode setting item, a sound mode is determined.

[0026] Technical effect: There is a sound mode setting item in the sound setting page and it is triggerable. Users can determine the sound mode according to their own needs by setting the sound mode setting item, thereby realizing personalized setting of the sound mode and improving user experience.

[0027] In some embodiments, the sound channels of the local device and the external device that need to be processed by sound effects are determined by a sound mode; the processor performs the sound mode determination process and is configured to:

[0028] The audio data to be played is identified to obtain a sound mode adapted to the audio data to be played.

[0029] Technical effect: By identifying the audio data to be played, a sound pattern adapted to the audio data to be played is obtained, and the sound pattern adapted to the audio data to be played is used for joint audio playback, which can ensure that the output spatial sound field effect matches the required sound experience of the audio data to be played, thereby helping to improve the user experience.

[0030] In some embodiments, the processor is further configured to:

[0031] When the connected external device supports the first sound effect processing, the external device is connected for the first time and the external device supports joint sound, the joint sound is turned on and a second prompt screen is displayed, wherein the second prompt screen is used to prompt that the joint sound has been turned on.

[0032] Technical effect: When an external device that supports joint sound and the first sound effect processing is connected for the first time, the processor automatically turns on the joint sound and displays the second prompt screen to prompt the user that they can experience the spatial sound field effect brought by the joint sound, which is conducive to improving the user experience.

[0033] In some embodiments, the processor is further configured to:

[0034] In response to a trigger operation of the sound setting portal, a sound setting page is displayed, wherein the sound setting page includes at least one connectable device option, wherein the at least one connectable device option includes an option for joint sound generation between the local device and the external device, an option for the local device to generate sound alone, and an option for the external device to generate sound alone;

[0035] In response to a switching operation on the at least one connectable device option, joint sounding is turned on or off, and the device corresponding to the switched connectable device option makes a sound.

[0036] Technical effect: By responding to the switching operation for at least one connectable device option, the joint sound is turned on or off. The joint sound, the sound of the local device or the external device can be set by the user according to their own needs, which improves the flexibility of the sound effect setting and is conducive to meeting the user's personalized needs for sound effects.

[0037] In a second aspect, some embodiments further provide an audio processing method, which is applied to the display device provided in the first aspect, wherein the display device includes: a display, one or more external device interfaces, and at least one processor, and the method includes:

[0038] Receiving an access signal sent by an external device that has been connected, and determining that the external device that has been connected supports the first sound effect processing if the access signal includes a first identifier that supports the first sound effect processing; and determining that the external device that has been connected does not support the first sound effect processing if the access signal does not include the first identifier that supports the first sound effect processing;

[0039] When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the audio file is parsed into pulse code modulation data, the pulse code modulation data is at least processed with the first sound effect, and the processed pulse code modulation data is sent to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

[0040] Technical effect: According to whether the access signal sent by the connected external device contains the first identifier of supporting the first sound effect processing, it is helpful to determine whether the connected external device supports the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local device parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method of performing the first sound effect processing on the local device and playing audio by the external device can greatly enhance the output spatial sound field effect compared to the external device playing audio based on pulse code modulation data that has not been processed by the first sound effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0042] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0043] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0044] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0045] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0046] Figure 5 Schematic diagram of the process of the audio processing method provided in some embodiments of the present application Figure 1 ;

[0047] Figure 6 Schematic diagram of the process of the audio processing method provided in some embodiments of the present application Figure 2 ;

[0048] Figure 7 Schematic diagram of the process of the audio processing method provided in some embodiments of the present application Figure 3 ;

[0049] Figure 8 A schematic diagram of an interface for sound effect settings provided in some embodiments of the present application;

[0050] Fig. 9 Schematic diagram of the process of the audio processing method provided in some embodiments of the present application Figure 4 ;

[0051] Fig.10 A schematic diagram of a first prompt screen provided in some embodiments of the present application;

[0052] Fig.11 Schematic diagram of the process of the audio processing method provided in some embodiments of the present application Figure 5 ;

[0053] Fig.12 A schematic diagram of a second prompt screen provided in some embodiments of the present application;

[0054] Fig.13 A schematic diagram of at least one connectable device option in a sound setting page provided in some embodiments of the present application;

[0055] Fig.14 An internal structural diagram of a computer device provided for some embodiments of the present application. DETAILED DESCRIPTION

[0056] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0057] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0058] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0059] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0060] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0061] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0062] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0063] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0064] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0065] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0066] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0067] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0068] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0069] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0070] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0071] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0072] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0073] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0074] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0075] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0076] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0077] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0078] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0079] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0080] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0081] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0082] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0083] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0084] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0085] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0086] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0087] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0088] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0089] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0090] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.

[0091] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0092] Native apps can support online or offline, message push or local resource access.

[0093] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0094] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0095] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0096] With the rapid development of display device functions, the functions that display devices can provide to users are becoming more and more abundant. At present, display devices include smart TVs, smart set-top boxes, smart boxes, and products with smart display screens. Taking smart TVs as an example, in order to improve the output sound effect of smart TVs, a sound bar device can be connected to the smart TV to output specific sound field effects.

[0097] However, after the smart TV is connected to a sound bar device, the built-in sound effects of the smart TV are always unavailable, and the sound field effect output by the smart TV depends on the hardware configuration of the connected sound bar device. Figure 5 The following is a schematic diagram of the process of the audio processing method provided by some embodiments. Figure 1 . The sound bar device connected to the display device supports the first sound effect processing, and the smart TV parses the audio resources, and transmits the parsed audio resources to the sound bar device through a preset audio transmission protocol. For example, the preset audio transmission protocol may be a CEC (Consumer Electronics Control) protocol. Then, the sound bar device performs corresponding sound effect processing on the parsed audio resources, and then the sound bar device produces sound. Sound effect processing may include a first sound effect processing and a second sound effect processing. The spatial sound field effect of the sound after the first sound effect processing is better than that of the second sound effect processing. For example, the first sound effect processing may use Dolby Atmos audio technology. In this audio processing method, if the sound bar device does not support the first sound effect processing, the first sound effect processing process will be missing, affecting the user's sound experience. Figure 6 The following is a schematic diagram of the process of the audio processing method provided by some embodiments. Figure 2 The dotted line portion indicates that the sound bar device lacks the first sound effect processing process.

[0098] Therefore, traditional display devices have the problem of poor output sound quality and cannot meet users' demand for high-quality sound field effects.

[0099] In order to solve the problem of poor output sound effects in traditional display devices, an embodiment of the present application provides an audio processing method, which is conducive to determining whether the connected external device supports the first sound effect processing based on whether the access signal sent by the connected external device contains a first identifier that supports the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local device parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method in which the local device performs the first sound effect processing on behalf of the external device and the external device plays the audio can greatly enhance the output spatial sound field effect compared to the external device playing audio based on the pulse code modulation data that has not been processed by the first sound effect.

[0100] like Figure 7 FIG. 1 is a flow chart showing an audio processing method provided by some embodiments. Figure 3 The method is applied to the above-mentioned display device, the display device includes: a display, one or more external device interfaces and at least one processor, and the method includes:

[0101] S100, receiving an access signal sent by a connected external device, and determining that the connected external device supports the first sound effect processing when the access signal includes a first identifier for supporting the first sound effect processing; and determining that the connected external device does not support the first sound effect processing when the access signal does not include the first identifier for supporting the first sound effect processing.

[0102] Among them, the external device refers to a device with audio playback function. The first sound effect processing refers to the method of using advanced audio technology to enhance the sound effect, including sound quality, atmosphere creation, emotional expression and other sound effects, so that the sound sounds with different spatial characteristics. Compared with traditional sound effect processing, the first sound effect processing can provide a better auditory experience.

[0103] For example, traditional sound processing generally refers to basic stereo or simple surround sound technology, which may not have advanced audio processing capabilities and is widely used in display devices, computer devices, mobile terminals and other consumer electronic devices. The audio technologies used in traditional sound processing include but are not limited to EQ (Equalizer), DRC (Dynamic Range Compression), PEQ (Parametric Equalizer), etc.

[0104] Exemplarily, the audio technology used in the first sound effect processing includes but is not limited to Dolby Atmos, and DTS:X, etc. Among them, Dolby Atmos is an advanced audio technology that can provide a three-dimensional surround sound experience, allowing sound to move in three-dimensional space, including overhead sound. Unlike traditional stereo and 5.1 or 7.1 channel systems, Dolby Atmos can move sound not only in the horizontal plane, but also in the vertical plane, thereby creating a more realistic sound effect. This technology is mainly used in cinemas, high-end home theater systems, streaming services, and some high-end audio equipment.

[0105] Among them, DTS:X is an immersive audio technology developed by DTS, known for its high sound quality and rich sound details. It is similar to Dolby Atmos and can provide a three-dimensional surround sound experience. It is widely used in movies, Blu-ray discs and home theater systems. DTS:X can move sound not only on the horizontal plane, but also on the vertical plane to create a more realistic sound effect. An important feature of DTS:X is its flexibility. Unlike Dolby Atmos, DTS:X does not require a specific speaker layout or a specific number of audio channels. Instead, it can automatically optimize audio output based on the speaker settings and the specific conditions of the room. In addition, DTS:X also supports the Dialogue Control function, which means that users can independently adjust the volume of the dialogue without affecting other sound effects, thereby providing a better listening experience.

[0106] In some embodiments, the direct communication protocol between the local device and the external device adopts the CEC protocol. After the external device is connected to the local device, an access signal will be sent to the local device. After receiving the access signal, the local device determines whether the external device supports the first sound effect processing based on the access signal.

[0107] The first identifier is identification information in the access signal, which is used to indicate whether the corresponding external device supports the first sound effect processing. If the access signal of the connected external device contains the first identifier, it means that the external device supports the first sound effect processing. If the access signal of the connected external device does not contain the first identifier, it means that the external device does not support the first sound effect processing.

[0108] S200. When the connected external device does not support the first sound effect processing and the first sound effect is turned on, parse the audio file into pulse code modulation data, perform at least the first sound effect processing on the pulse code modulation data, and send the processed pulse code modulation data to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

[0109] The first sound effect refers to a function of performing the first sound effect processing on behalf of the machine. In some embodiments, the display device includes a human-computer interaction interface, and a plurality of function interfaces can be displayed in the human-computer interaction interface. The processor can determine whether the first sound effect is turned on by determining whether the first sound effect option in the interface for sound effect setting is turned on. Figure 8 The diagram shows a schematic diagram of an interface for sound effect settings provided by some embodiments. The first sound effect includes an on state and an off state, and the state of the first sound effect can be adjusted in response to a user's selection operation. The first sound effect is turned on to indicate that the function of performing the first sound effect processing by the machine is turned on.

[0110] Audio files refer to audio resources built into the processor. Parsing audio files is mainly the encoding process of converting analog signals into digital signals. For example, the PCM (Pulse-Code Modulation) encoding method can be used to parse audio files. Pulse code modulation data is the digital signal obtained after parsing the audio file. Using PCM encoding technology, analog audio signals represented by waveforms can be converted into digital audio signals represented by digital 1 and 0 without compression or loss of information.

[0111] In the traditional method, when the display device is connected to an external device, the display device only performs conventional audio analysis processing on the audio file, and the specific sound effect processing is performed by the external device. In the embodiment of the present application, the local processor can perform the first sound effect processing on the pulse code modulation data, obtain the processed pulse code modulation data and send it to the connected external device. In this way, if the external device does not support the first sound effect processing, the local processor can perform the first sound effect processing on the external device, and the external device can play the audio. Since the external device plays the data after the first sound effect processing, it is beneficial to improve the output sound effect.

[0112] In the embodiment of the present application, in addition to performing the first sound effect processing on the pulse code modulation data, the local machine can also perform traditional sound effect processing on the pulse code modulation data. The external device plays audio based on the processed pulse code modulation data, and the output spatial sound field effect can include both the sound effects corresponding to the first sound effect processing and the sound effects corresponding to the traditional sound effect processing.

[0113] In some embodiments, if the connected external device does not support the first sound effect processing and the first sound effect has been turned off, the first sound effect has been turned off to indicate that the function of performing the first sound effect processing by the local device has been turned off, then the processor will adopt a traditional audio processing method to perform audio processing, that is, to parse the audio file into pulse code modulation data, and send the pulse code modulation data to the external device to instruct the external device to perform a second sound effect processing based on the pulse code modulation data, and perform audio playback based on the pulse code modulation data after the second sound effect processing.

[0114] The second sound effect processing is the traditional sound effect processing. Figure 6 , the processor decodes the audio file to obtain pulse code modulation data and sends it to the external device. Since the external device does not support the first sound effect processing, the external device performs the second sound effect processing based on the pulse code modulation data, and plays the audio based on the pulse code modulation data after the second sound effect processing. Due to the lack of the first sound effect processing, the spatial sound field effect of the audio playback based on the pulse code modulation data after the second sound effect processing is inferior to the spatial sound field effect of the audio playback performed by the external device after the first sound effect processing is performed by the local device.

[0115] The above-mentioned display device and desktop theme display method are helpful for determining whether the connected external device supports the first sound effect processing according to whether the access signal sent by the connected external device contains the first identifier of supporting the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local device parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method of performing the first sound effect processing on the local device and playing audio by the external device can greatly enhance the output spatial sound field effect compared to the external device playing audio based on pulse code modulation data that has not been processed by the first sound effect.

[0116] In the traditional method, after an external device is inserted into the display device, the sound effect-related setting items in the local device are not triggerable. In the embodiment of the present application, when the connected external device does not support the first sound effect processing and the first sound effect is turned on, the processor adjusts the sound effect-related setting items in the local device to be triggerable, which is conducive to improving the diversity of sound effect types.

[0117] In some embodiments, in response to performing at least a first sound effect processing on the pulse code modulation data, the process includes: when the connected external device does not support the first sound effect processing and the first sound effect is turned on, in response to a triggering operation of the sound setting entry, displaying a sound setting page; at least a first sound effect setting item exists in the sound setting page and is triggerable; in response to a setting operation for the first sound effect setting item, obtaining a sound effect setting result, performing a first sound effect processing on the pulse code modulation data according to the sound effect setting result, and obtaining processed pulse code modulation data.

[0118] The sound setting entry refers to an entry into a sound-related setting page, and illustratively, may be a sound setting option in a human-computer interaction interface.

[0119] The sound setting entry can be automatically displayed when it is detected that the connected external device does not support the first sound effect processing and the first sound effect is turned on, or the sound setting entry can be displayed in response to the user's selection operation on the page where the sound setting entry is located based on a preset path. Exemplarily, the remote control sends a corresponding signal to the processor in response to the user's click operation on the "MENU" button, and the processor displays the page where the sound setting entry is located after receiving the signal.

[0120] The sound setting page refers to a setting page for setting the sound. The sound setting page can be a single page or a multi-level page, and each level of the page has a preset jump relationship. The sound setting page can be automatically displayed after the sound setting entry is triggered.

[0121] The first sound effect setting item refers to an option for setting the sound effect in the sound setting page. The sound setting page has at least the first sound effect setting item, for example, there may also be a timbre adjustment setting item, etc. There may be one or more first sound effect setting items in the sound setting page.

[0122] The sound effect setting result refers to the setting result related to the sound effect in the local device. Since the local device supports the first sound effect processing, the sound effect setting result may be the setting result related to the first sound effect processing. For example, the sound effect setting result may be the setting result related to Dolby Atmos.

[0123] At least a first sound effect setting item exists in the sound setting page and is triggerable, so that the first sound effect setting item can be set by the user according to his or her own needs. Different first sound effect setting items are triggered, and the processor can determine that the sound effect setting result is the sound effect type corresponding to the triggered first sound effect setting item. For example, the setting operation of the first sound effect setting item is to turn on Dolby Atmos. In response to the setting operation of turning on Dolby Atmos, the sound effect setting result at least includes turning on Dolby Atmos.

[0124] The processor performs the first sound effect processing on the pulse code modulation data according to the sound effect setting result, thereby improving the flexibility of the sound effect setting. The processed pulse code modulation data is used for audio playback by an external device, which is beneficial to improving the spatial sound field effect of the output sound.

[0125] In an embodiment of the present application, the first sound effect setting item is triggerable. When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the triggerable first sound effect setting item is displayed in response to the trigger operation of the sound setting entrance. In this way, the user can set the first sound effect setting item according to his or her own needs, thereby improving the diversity of the sound effect setting results. The first sound effect processing is performed on the pulse code modulation data based on the sound effect setting results, which is beneficial to improving the spatial sound field effect of the output sound.

[0126] In some embodiments, in order to further improve the sound effect of the output sound, additional sound effect setting methods can be added. For example, there is also a sound mode setting item in the sound setting page and it is triggerable. The sound mode is used to determine the sound channel used by the external device. In this way, in response to the setting operation for the first sound effect setting item, the sound effect setting result is obtained, including: in response to the setting operation for at least one of the first sound effect setting item or the sound mode setting item, the sound effect setting result is obtained.

[0127] The audio channel refers to independent audio signals that can be played back at different spatial locations during playback. Different audio channels will produce different sound effects.

[0128] There is also a sound mode setting item in the sound setting page and it is triggerable. The sound mode setting item is used to set the sound mode. Among them, the sound mode is used to determine the channel used by the external device. For example, the sound mode includes movie mode, music mode, sports mode, etc. The channels corresponding to the music mode include the front left channel, front right channel, center channel, subwoofer channel, sky sound left channel and sky sound right channel.

[0129] Since the sound mode setting item is triggerable, the user can set the sound mode setting item according to his or her own needs. The first sound effect setting item and the sound mode setting item in the sound setting page can be set separately or simultaneously. The processor obtains the sound effect setting result in response to the setting operation for at least one of the first sound effect setting item or the sound mode setting item.

[0130] like Fig. 9 The following is a schematic diagram of the process of the audio processing method provided by some embodiments. Figure 4 The processor obtains a sound effect setting result in response to a setting operation of the user on at least one of the first sound effect setting item or the sound mode setting item; performs audio decoding on the obtained audio data, and then performs a first sound effect processing based on the sound effect setting result and the decoded audio data to obtain a first audio signal. For example, the first audio signal may be PCM data including the first sound effect processing result and the second sound effect processing result; the first audio signal is then transmitted to an external device through a CEC protocol, and the external device performs audio playback based on the first audio signal.

[0131] In an embodiment of the present application, the sound setting page also includes a sound mode setting item that is triggerable. In this way, the user can set at least one of the first sound effect setting item or the sound mode setting item according to their own needs, further improving the diversity of the sound effect setting results. Audio processing is performed based on the sound effect setting results, which is conducive to improving the spatial sound field effect of the output sound.

[0132] In some embodiments, the audio processing method also includes: when the connected external device does not support the first sound effect processing and the external device is connected for the first time, displaying a first prompt screen, the first prompt screen is used to prompt that the first sound effect processing can be performed by the local device by turning on the first sound effect.

[0133] The first prompt screen is a page for prompting the user to enable the first sound effect and have the machine perform the first sound effect processing on the user. Fig.10 Shown is a schematic diagram of a first prompt screen provided in some embodiments.

[0134] When an external device that does not support the first sound effect processing is connected for the first time, a first prompt screen is displayed to prompt the user to experience a better sound field effect by turning on the first sound effect.

[0135] In an embodiment of the present application, when an external device that does not support the first sound effect processing is connected for the first time, the user can be prompted to turn on the first sound effect by displaying a first prompt screen, so as to experience the sound effect of the first sound effect processing performed by the local device, which is conducive to improving the user experience.

[0136] In some embodiments, for an external device that supports the first sound effect processing, the spatial sound field effect can be enhanced by turning on joint sound. The audio processing method also includes: when the connected external device supports the first sound effect processing and the joint sound is turned on, parsing the audio file into pulse code modulation data, performing sound effect processing on the pulse code modulation data of at least part of the channels, and sending the pulse code modulation data of at least part of the channels to the external device, which performs sound effect processing; based on the processed pulse code modulation data of at least part of the channels, performing joint audio playback with the external device.

[0137] The joint sounding refers to a function in which the local device and the external device simultaneously sound. Exemplarily, the processor may determine whether the joint sounding is turned on by determining whether the joint sounding option in the sound setting page is turned on.

[0138] The audio data in the audio file can be sounded using multiple channels. In order to enhance the spatial sound field effect, the multiple channels can be respectively allocated to the local machine and the external device, so that the local machine and the external device can sound at the same time, thus realizing the joint sound function.

[0139] The channels allocated by the local device and the channels allocated by the external device may be the same or different, may have repeated channels or may not have repeated channels, and the total channels allocated by the two devices can cover the channels corresponding to the pulse code modulation data.

[0140] The local processor performs sound effect processing on the pulse code modulation data of at least part of the channels allocated thereto to obtain processed pulse code modulation data of at least part of the channels. The processed pulse code modulation data of at least part of the channels may include sound effects that the local processor can support.

[0141] The processor sends the pulse code modulation data of at least part of the channels to an external device, and the external device performs sound effect processing on the pulse code modulation data of at least part of the channels to obtain the pulse code modulation data of at least part of the channels after the second processing. Since the external device supports the first sound effect processing, the external device performs audio playback based on the pulse code modulation data of at least part of the channels after the second processing, and can output the spatial sound field effect corresponding to the first sound effect processing.

[0142] The local device plays audio based on the pulse code modulation data of at least part of the channels processed by the local device, and the external device plays audio based on the pulse code modulation data of at least part of the channels processed by the second device. Moreover, the local device and the external device play audio simultaneously, thereby realizing the joint sound generation function.

[0143] In an embodiment of the present application, for an external device that supports the first sound effect processing, by turning on joint sound, the local machine parses the audio file into pulse code modulation data, performs sound effect processing on the pulse code modulation data of at least part of the channels, and the external device performs sound effect processing on the pulse code modulation data of at least part of the channels, and the two perform joint audio playback to achieve the joint sound emission function; since the sound effect functions supported by the local machine and the external device may be different, the method of joint sound emission by splitting the channels can combine the sound effect capability advantages of the two and greatly enhance the spatial sound field effect of the output sound.

[0144] In some embodiments, the sound channels of the local machine and the external device that need to be processed for sound effects are determined by the sound mode; the process of determining the sound mode includes: in response to a trigger operation of the sound setting entrance, displaying a sound setting page, in which a sound mode setting item exists and is triggerable; in response to a setting operation for the sound mode setting item, determining the sound mode.

[0145] The channels that need to be processed for sound effects by the local device and the external device can be determined by the sound mode. In this way, different channel combinations can be determined in different sound modes, which is conducive to outputting spatial sound field effects that conform to the sound mode, thereby improving user experience. Table 1 shows the channel combinations in different sound modes in some embodiments.

[0146] Table 1 Channel combinations in different sound modes

[0147] Sound Mode External devices This machine Movie Mode Front left, front right, center, surround left, surround right, subwoofer Front left, front right, sky sound left, sky sound right Sport Mode Front Left, Front Right, Center, Surround Left, Surround Right Front left, front right, bass Music Mode Front left, front right, center Front left, front right, subwoofer, sky sound left, sky sound right Speech Mode central Front left, front right Night Mode Front left, front right, center none

[0148] Among them, Movie Mode: In Movie Mode, we hope to provide the richest and most three-dimensional sound experience. Therefore, all channels, including front, rear, center, surround and low-frequency effects, can be sent to external devices for processing. At the same time, the front left, front right, low-frequency effects and two sky sound channels of this unit can also be used to increase the sense of space and three-dimensionality, providing a richer movie viewing experience.

[0149] Sports mode: In sports mode, we want to provide a stronger sense of presence. Therefore, the front, rear and surround channels of the external device can be used to provide a wider sound field. At the same time, the front left, front right and low-frequency effects of this unit can also be used to enhance the atmosphere and dynamics of the scene.

[0150] Music Mode: In Music Mode, we want to provide the purest and most realistic music experience. Therefore, the front and center channels of the external device can be used to clearly transmit the sound of vocals and instruments. At the same time, the front left, front right, low-frequency effects and two sky sound channels of this unit can also be used to increase the sense of space and layering of the music.

[0151] Speech mode: In speech mode, we want to provide the clearest and most direct sound experience. Therefore, the center channel of the external device is used to clearly transmit the speaker's voice. At the same time, the front left and front right channels of the unit can also be used to increase the width and clarity of the sound.

[0152] Night Mode: In night mode, we want to provide the quietest and most comfortable sound experience. Therefore, the front and center channels of the external device can be used to provide sufficient sound clarity while keeping the overall sound level low. In this mode, the local channels can be unused to avoid excessive or loud sound.

[0153] There is a sound mode setting item in the sound setting page and it is triggerable. There may be one or more sound mode setting items in the sound setting page. In the traditional method, after the external device is inserted, the sound mode is not triggerable. In the embodiment of the present application, the sound mode is triggerable, so that the sound mode can be set by the user according to his own needs.

[0154] For an external device that supports the first sound effect processing, the processor displays a sound setting page in response to a trigger operation of the sound setting entry. The sound setting entry can be automatically displayed when it is detected that the connected external device supports the first sound effect processing and the joint sound generation is turned on, or it can be displayed in response to a user's selection operation of the page where the sound setting entry is located based on a preset path.

[0155] In some embodiments, the sound mode setting items correspond to the sound modes one by one. The processor determines the sound mode in response to the setting operation for the sound mode setting items. For example, if the user selects "movie mode" from the multiple sound mode setting items, the sound mode is determined to be the movie mode.

[0156] like Fig.11 The following is a schematic diagram of the process of the audio processing method provided by some embodiments. Figure 5 . Among them, the processor responds to the sound mode selected by the user, splits the channels of the decoded audio data based on the sound mode, and determines the channels that the local machine and the external device need to perform sound effect processing on respectively. The local processor determines the audio data with at least part of the channels that the local machine needs to process based on the channel parameters corresponding to the channels assigned to the local machine, and performs the first sound effect processing and the second sound effect processing on the audio data; the processor sends the channel parameters and audio data corresponding to the channels assigned to the external device to the external device, and the external device determines the audio data with at least part of the channels based on the received channel parameters and audio data, and performs the first sound effect processing and the second sound effect processing on the audio data; finally, the local machine and the external device perform joint audio playback.

[0157] In the embodiment of the present application, there is a sound mode setting item in the sound setting page and it is triggerable. The user can determine the sound mode according to his or her own needs by setting the sound mode setting item, thereby realizing personalized setting of the sound mode and improving the user experience.

[0158] In some embodiments, the sound channels of the local device and the external device that need to be processed by sound effects are determined by the sound mode; the process of determining the sound mode includes: identifying the audio data to be played and obtaining a sound mode adapted to the audio data to be played.

[0159] The processor may identify the audio data to be played, thereby determining a sound mode that is compatible with the audio data to be played.

[0160] For example, the processor identifies the audio data and determines that the audio data contains human voices and sounds of musical instruments, and determines the sound mode as a music mode. For another example, the processor identifies that the audio data is audio data in a sports scene, and determines the sound mode as a sports mode. For another example, the processor obtains the source of the audio data and determines that the source of the audio data belongs to the movie type, and determines the sound mode as a movie mode. For another example, the processor determines that the source of the audio data belongs to the speech type, and determines the sound mode as a speech mode. For another example, the processor determines that the time to play the audio data is at night, and determines the sound mode as a night mode.

[0161] In an embodiment of the present application, by identifying the audio data to be played, a sound pattern adapted to the audio data to be played is obtained, and the sound pattern adapted to the audio data to be played is used for joint audio playback, which can ensure that the output spatial sound field effect matches the required sound experience of the audio data to be played, thereby helping to improve the user experience.

[0162] In some embodiments, the audio processing method also includes: when the connected external device supports the first sound effect processing, the external device is connected for the first time and the external device supports joint sound, turning on the joint sound and displaying a second prompt screen, the second prompt screen is used to prompt that the joint sound has been turned on.

[0163] Among them, when an external device that supports joint sound and supports the first sound effect processing is connected for the first time, the processor can automatically turn on the joint sound so that the user can experience the spatial sound field effect brought by the joint sound.

[0164] The second prompt screen is a page for prompting the user that joint voice has been turned on. Fig.12 Shown is a schematic diagram of a second prompt screen provided in some embodiments.

[0165] In an embodiment of the present application, when an external device that supports joint sound and supports the first sound effect processing is connected for the first time, the processor automatically turns on the joint sound and displays a second prompt screen to prompt the user that they can experience the spatial sound field effect brought by the joint sound, which is conducive to improving the user experience.

[0166] In some embodiments, the audio processing method also includes: in response to a trigger operation of a sound setting entrance, displaying a sound setting page, wherein there is at least one connectable device option in the sound setting page, and the at least one connectable device option includes an option for joint sound emission between the local device and an external device, an option for the local device to emit sound alone, and an option for an external device to emit sound alone; in response to a switching operation for at least one connectable device option, turning the joint sound on or off, and the device corresponding to the switched connectable device option emits sound.

[0167] The connectable device option is used to indicate the sound scheme selected when the device is connected to an external device. After the display device is connected to an external device, it can be selected that the device alone sounds, the external device alone sounds, or the device and the external device jointly sounds.

[0168] In some embodiments, in response to a switching operation for at least one connectable device option, if the option is switched to joint sounding between the local device and the external device, the joint sounding is turned on, and the local device and the external device jointly sound. If the option is switched to the local device making a sound alone, the joint sounding is turned off, and the local device makes the sound. If the option is switched to the external device making a sound alone, the joint sounding is turned off, and the external device makes the sound. In this way, the sounding device can be determined according to the user's choice, thereby improving the flexibility of sound effect processing.

[0169] like Fig.13 Shown is a schematic diagram of at least one connectable device option in the sound settings page provided by some embodiments. Since external devices can exchange data with this machine using different communication protocols, external devices are of various types. For example, Bluetooth devices, sound bar devices, optical fiber audio output devices (SPDIF, Sony / Philips Digital Interface), etc. In the figure, if any one of the Bluetooth devices and SPDIF devices is selected, it means that the corresponding external device will make a sound alone. If the local machine and the sound bar device are selected to make a sound together, it means that the local machine and the sound bar device will make a sound together. If the local speaker is selected, it means that the local machine makes a sound alone. In some embodiments, after the sound bar device is inserted, the option of the eARC (Enhanced Audio Return Channel) device is turned on by default.

[0170] In an embodiment of the present application, by responding to a switching operation for at least one connectable device option, the joint sound is turned on or off, and the joint sound, the local sound or the external device's individual sound can be set by the user according to their own needs, thereby improving the flexibility of the sound effect setting and facilitating meeting the user's personalized needs for sound effects.

[0171] To explain the display device and the audio processing method and the effect in this solution in detail, a most detailed embodiment is described below:

[0172] In an embodiment of the present application, a display device is provided, comprising: a display, one or more external device interfaces, and at least one processor. The display is configured to display content from a broadcast system or network and / or a user interface; the one or more external device interfaces are used to communicate with one or more external devices according to a communication protocol, and the communication protocol includes at least a Bluetooth protocol; and at least one processor is connected to the display and the one or more external device interfaces and is configured to execute an audio processing method.

[0173] The display device first determines whether the connected external device supports the first sound effect processing. Specifically, the display device receives an access signal sent by the connected external device, and when the access signal includes a first identifier of supporting the first sound effect processing, it is determined that the connected external device supports the first sound effect processing; when the access signal does not include the first identifier of supporting the first sound effect processing, it is determined that the connected external device does not support the first sound effect processing.

[0174] The audio processing process is different for external devices that do not support the first sound effect processing and those that support the first sound effect processing. Among them, for an external device that has been connected and does not support the first sound effect processing, the audio processing method includes: when the external device that has been connected does not support the first sound effect processing and the first sound effect has been turned on, parsing the audio file into pulse code modulation data, performing at least the first sound effect processing on the pulse code modulation data, and sending the processed pulse code modulation data to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

[0175] Among them, at least the first sound effect processing is performed on the pulse code modulation data, including: when the connected external device does not support the first sound effect processing and the first sound effect is turned on, in response to the triggering operation of the sound setting entrance, the sound setting page is displayed; at least the first sound effect setting item exists in the sound setting page and is triggerable; in response to the setting operation for the first sound effect setting item, the sound effect setting result is obtained, and the first sound effect processing is performed on the pulse code modulation data according to the sound effect setting result to obtain the processed pulse code modulation data.

[0176] In some embodiments, there is also a sound mode setting item in the sound setting page and it is triggerable. The sound mode is used to determine the sound channel used by the external device. In response to the setting operation for the first sound effect setting item, the sound effect setting result is obtained, including: in response to the setting operation for at least one of the first sound effect setting item or the sound mode setting item, the sound effect setting result is obtained.

[0177] In some embodiments, when the connected external device does not support the first sound effect processing and the external device is connected for the first time, a first prompt screen is displayed, and the first prompt screen is used to prompt that the first sound effect can be turned on to allow the local device to perform the first sound effect processing.

[0178] For a connected external device that supports a first sound effect processing, the audio processing method includes: when the connected external device supports the first sound effect processing and joint sound is turned on, parsing the audio file into pulse code modulation data, performing sound effect processing on the pulse code modulation data of at least part of the channels, and sending the pulse code modulation data of at least part of the channels to the external device, which performs sound effect processing; based on the processed pulse code modulation data of at least part of the channels, performing joint audio playback with the external device.

[0179] In some embodiments, the sound channels of the local machine and the external device that need to be processed for sound effects are determined by the sound mode; the process of determining the sound mode includes: in response to a trigger operation of the sound setting entrance, displaying a sound setting page, in which a sound mode setting item exists and is triggerable; in response to a setting operation for the sound mode setting item, determining the sound mode.

[0180] In other embodiments, the sound channels of the local device and the external device that need to be processed by sound effects are determined by the sound mode; the process of determining the sound mode includes: identifying the audio data to be played and obtaining a sound mode adapted to the audio data to be played.

[0181] In some embodiments, when the connected external device supports the first sound effect processing, the external device is connected for the first time and the external device supports joint sound, the joint sound is turned on and a second prompt screen is displayed. The second prompt screen is used to prompt that the joint sound has been turned on.

[0182] In some embodiments, in response to a triggering operation of a sound setting entrance, a sound setting page is displayed, in which there is at least one connectable device option, and the at least one connectable device option includes an option for joint sound emission between the local device and an external device, an option for the local device to emit sound alone, and an option for an external device to emit sound alone; in response to a switching operation for at least one connectable device option, the joint sound emission is turned on or off, and the device corresponding to the switched connectable device option emits sound.

[0183] In the above embodiment, a display device and an audio processing method are helpful for determining whether the connected external device supports the first sound effect processing according to whether the access signal sent by the connected external device contains a first identifier for supporting the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local device parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method in which the local device performs the first sound effect processing on behalf of the external device and the external device plays audio can greatly enhance the output spatial sound field effect compared to the external device playing audio based on the pulse code modulation data that has not been processed by the first sound effect.

[0184] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0185] Based on the same inventive concept, the embodiment of the present application also provides an audio processing device for implementing the audio processing method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in one or more audio processing device embodiments provided below can refer to the limitations on the audio processing method above, and will not be repeated here.

[0186] In an exemplary embodiment, an audio processing device is provided, comprising: a determination module and a processing module, wherein:

[0187] A determination module, configured to receive an access signal sent by an external device that has been connected, and determine that the external device that has been connected supports the first sound effect processing when the access signal includes a first identifier that supports the first sound effect processing; and determine that the external device that has been connected does not support the first sound effect processing when the access signal does not include the first identifier that supports the first sound effect processing;

[0188] A processing module is used to parse the audio file into pulse code modulation data, perform at least the first sound effect processing on the pulse code modulation data, and send the processed pulse code modulation data to the external device to instruct the external device to play audio based on the processed pulse code modulation data when the connected external device does not support the first sound effect processing and the first sound effect is turned on.

[0189] In some embodiments, in terms of performing at least a first sound effect processing on the pulse code modulation data, the processing module is also used for: when the connected external device does not support the first sound effect processing and the first sound effect is turned on, in response to a triggering operation of the sound setting entrance, displaying a sound setting page; at least a first sound effect setting item exists in the sound setting page and is triggerable; in response to a setting operation for the first sound effect setting item, obtaining a sound effect setting result, performing the first sound effect processing on the pulse code modulation data according to the sound effect setting result, and obtaining processed pulse code modulation data.

[0190] In some embodiments, there is also a sound mode setting item in the sound setting page and it is triggerable, and the sound mode is used to determine the sound channel used by the external device; in response to the setting operation for the first sound effect setting item, the sound effect setting result is obtained, and the processing module is also used to: in response to the setting operation for the first sound effect setting item or at least one of the sound mode setting items, obtain the sound effect setting result.

[0191] In some embodiments, the audio processing device also includes a first prompt module, which is used to: when the connected external device does not support the first sound effect processing and the external device is connected for the first time, display a first prompt screen, and the first prompt screen is used to prompt that the first sound effect can be processed by the local device by turning on the first sound effect.

[0192] In some embodiments, the audio processing device also includes a joint sound module, which is used to: when the connected external device supports the first sound effect processing and the joint sound is turned on, parse the audio file into pulse code modulation data, perform sound effect processing on the pulse code modulation data of at least part of the channels, and send the pulse code modulation data of at least part of the channels to the external device, which performs sound effect processing; based on the processed pulse code modulation data of at least part of the channels, perform joint audio playback with the external device.

[0193] In some embodiments, the sound channels of the local machine and the external device that need to be processed for sound effects are determined by the sound mode; in terms of determining the sound mode, the joint sound module is also used to: respond to the trigger operation of the sound setting entrance, display the sound setting page, and the sound setting page contains a sound mode setting item that is triggerable; determine the sound mode in response to the setting operation for the sound mode setting item.

[0194] In some embodiments, the sound channels of the local device and the external device that need to be processed are determined by the sound mode; in terms of determining the sound mode, the joint sound module is also used to: identify the audio data to be played and obtain a sound mode that is adapted to the audio data to be played.

[0195] In some embodiments, the audio processing device also includes a second prompt module, which is used to: when the connected external device supports the first sound effect processing, the external device is connected for the first time and the external device supports joint sound, turn on the joint sound and display a second prompt screen, and the second prompt screen is used to prompt that the joint sound has been turned on.

[0196] In some embodiments, the audio processing device also includes a joint sound off module, which is further used to: respond to a trigger operation of the sound setting entrance, display a sound setting page, in which there is at least one connectable device option, and the at least one connectable device option includes an option for joint sound between the local device and an external device, an option for the local device to make a single sound, and an option for an external device to make a single sound; respond to a switching operation for at least one connectable device option, turn on or off the joint sound, and the device corresponding to the switched connectable device option makes a sound.

[0197] The above-mentioned audio processing device is helpful for determining whether the connected external device supports the first sound effect processing according to whether the access signal sent by the connected external device contains the first identifier of supporting the first sound effect processing; when the connected external device does not support the first sound effect processing and the first sound effect of the display device is turned on, the local machine parses the audio file into pulse code modulation data, performs at least the first sound effect processing on the pulse code modulation data, and sends the processed pulse code modulation data to the external device, and the external device plays audio based on the processed pulse code modulation data. Since the connected external device does not support the first sound effect processing, this method of performing the first sound effect processing on the local machine and playing audio by the external device can greatly enhance the output spatial sound field effect compared to the external device playing audio based on pulse code modulation data that has not been processed by the first sound effect.

[0198] Each module in the above audio processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0199] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Fig.14 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, an audio processing method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0200] Those skilled in the art will understand that Fig.14 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0201] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0202] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0203] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0204] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0205] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0206] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0207] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A display device, characterized in that: include: a display configured to display content from a broadcast system or network and / or a user interface; one or more external device interfaces, for communicating with one or more external devices according to a communication protocol, the communication protocol comprising at least a Bluetooth protocol; and at least one processor, connected to the display and the one or more external device interfaces, and configured to execute instructions so that the display device is configured to: Receiving an access signal sent by an external device that has been connected, and determining that the external device that has been connected supports the first sound effect processing if the access signal includes a first identifier that supports the first sound effect processing; and determining that the external device that has been connected does not support the first sound effect processing if the access signal does not include the first identifier that supports the first sound effect processing; When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the audio file is parsed into pulse code modulation data, the pulse code modulation data is at least processed with the first sound effect, and the processed pulse code modulation data is sent to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

2. The display device according to claim 1, characterized in that The processor performs at least the first sound effect processing on the pulse code modulation data, and is configured to: In the case where the connected external device does not support the first sound effect processing and the first sound effect is turned on, in response to the triggering operation of the sound setting entry, a sound setting page is displayed; the sound setting page contains at least the first sound effect setting item and is triggerable; In response to the setting operation for the first sound effect setting item, a sound effect setting result is obtained, and the pulse code modulation data is subjected to first sound effect processing according to the sound effect setting result to obtain processed pulse code modulation data.

3. The display device according to claim 2, characterized in that The sound setting page also includes a sound mode setting item which is triggerable, and the sound mode is used to determine the sound channel used by the external device; the processor executes the setting operation in response to the first sound effect setting item to obtain the sound effect setting result, and is configured to: In response to a setting operation on at least one of the first sound effect setting item or the sound mode setting item, a sound effect setting result is acquired.

4. The display device according to claim 1, characterized in that The processor is further configured to: When the connected external device does not support the first sound effect processing and the external device is connected for the first time, a first prompt screen is displayed, wherein the first prompt screen is used to prompt that the first sound effect can be turned on to allow the local device to perform the first sound effect processing.

5. The display device according to claim 1, characterized in that The processor is further configured to: If the connected external device supports the first sound effect processing and the joint sound generation is turned on, parsing the audio file into pulse code modulation data, performing sound effect processing on the pulse code modulation data of at least part of the channels, and sending the pulse code modulation data of at least part of the channels to the external device, so that the external device performs the sound effect processing; Based on the processed pulse code modulation data of at least part of the channels, joint audio playback is performed with the external device.

6. The display device according to claim 5, characterized in that The sound channels of the local device and the external device that need to be processed by sound effects are determined by the sound mode; the processor performs the sound mode determination process and is configured to: In response to the triggering operation of the sound setting portal, a sound setting page is displayed, in which a sound mode setting item exists and is triggerable; In response to a setting operation for the sound mode setting item, a sound mode is determined.

7. The display device according to claim 5, characterized in that The sound channels of the local device and the external device that need to be processed by sound effects are determined by the sound mode; the processor performs the sound mode determination process and is configured to: The audio data to be played is identified to obtain a sound mode adapted to the audio data to be played.

8. The display device according to claim 5, characterized in that The processor is further configured to: When the connected external device supports the first sound effect processing, the external device is connected for the first time and the external device supports joint sound, the joint sound is turned on and a second prompt screen is displayed, wherein the second prompt screen is used to prompt that the joint sound has been turned on.

9. The display device according to claim 5, characterized in that The processor is further configured to: In response to a trigger operation of the sound setting portal, a sound setting page is displayed, wherein the sound setting page includes at least one connectable device option, wherein the at least one connectable device option includes an option for joint sound generation between the local device and the external device, an option for the local device to generate sound alone, and an option for the external device to generate sound alone; In response to a switching operation on the at least one connectable device option, joint sounding is turned on or off, and the device corresponding to the switched connectable device option makes a sound.

10. An audio processing method, characterized in that: Applied to the display device as claimed in any one of claims 1 to 9; the method comprises: Receiving an access signal sent by an external device that has been connected, and determining that the external device that has been connected supports the first sound effect processing if the access signal includes a first identifier that supports the first sound effect processing; and determining that the external device that has been connected does not support the first sound effect processing if the access signal does not include the first identifier that supports the first sound effect processing; When the connected external device does not support the first sound effect processing and the first sound effect is turned on, the audio file is parsed into pulse code modulation data, the pulse code modulation data is at least processed with the first sound effect, and the processed pulse code modulation data is sent to the external device to instruct the external device to play audio based on the processed pulse code modulation data.

Images